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Abstract 



Response latency was studied as a measure of associative strength 
or degree of learning and as a possible basis for instructional decision- 
making in computer-assisted instruction. Latency was investigated in a 
paired-associate task as a function of training procedure (a comparison of 
the anticipation and recall paradigms) and information transmission 
requirements (a comparison of two, four, and eight response alternatives 
to an eight item stimulus list) during both acquisition and overlearning. 

The magnitude and variability of latency measurements were independent of 
training method during acquisition, but both were reduced by the recall 
paradigm during overlearning. Latency was an increasing function of the 
number of response alternatives during both acquisition and overlearning. 

During acquisition, prior to the trial of last error (TLE) for 
each Item, latency remained relatively constant and did not differ between 
correct and incorrect responses. There was a substantial drop in latency 
following the TLE. Both pre- and post-TLE latencies were an increasing 
function of intrasubject differences in item difficulty. Pre-fLE laten- 
cies were an inverse function of subject learning rate. Post-TLE latencies 
were independent of subject learning rate. The latency of the first cor- 
rect response to an item was found to be shorter if there were no subsequent 
errors on that item. In general, the study suggests that latency, at least 
in a rote verbal learning task, may be a sensitive measure of strength of 
learning during the overlearning phase, but not during Initial learning. 
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Oiigln and History of the Problem 



Declalon Processes In Instruction 

The development of instructional strategies Is currently an area of 
considerable Interest to educators and psychologists. With the availability 
of computer-based Instructional systems, the educator now has the potential 
ability to construct Instructional sequences which will adapt to the partic- 
ular requirements of Individual students. Such a sequence would vary the 
content and order of the Instructional materials presented to the student 
as a function of the student's responses. The major problem facing the psy- 
chologist Interested In this area Is that the nature of the functions relat- 
ing the student's responses to optimal presentation schemes Is essentially 
unknown. The engineer has provided the educator with the ability to make 
extremely fast, relatively sophisticated decisions concerning Individual stu- 
dents, and the psychologist needs to be able to provide him with the basis 
for making such decisions. 

A frequent requirement Is simply to determine when a response has 
gained sufficient strength to allow the lesson to proceed to other material. 
Defining "sufficient strength" Is of course a problem, but a more Immediate 
problem Is that of simply measuring the strength of the behavior. One approach— 
perhaps the most common In practical group Instructional situations— Is to simply 
give all students that amount of practice which past experience has shown to 
be sufficient for the average student. This Is undesirable since It Ignores 
differences between Individuals. One practical solution Is to continue prac- 
tice until the student reaches some behavioral criterion which Is judged to 
be adequate. The common behavioral measure employed is response frequency. 

This Is also the most reasonable measure In most cases since the goal of the 
Instruction can usually be defined in terms of an Increase In the frequency 
of the correct response. Frequency is not, however, a completely adequate 
measure. If the Initial probability of the response Is fairly high or If the 
student Is able to make use of a constructive guessing strategy based on the 
previous occurrence of some Items, the frequency measure may be biased so as 
to cause the response strength to appear to be greater than It actually Is. 

Frequency measures also lose their sensitivity as response probability 
approaches asymptote. It Is desirable that the student retain what he has 
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learned, and it is known that retention is a function of the degree of learn- 
ing. One could continue Instruction to a criterion of n successive errorless 
responses where n has been found to be a sufficient number of trials to attain 
the desired degree of retention on the average, but again this process does 
not satisfy the criterion of adaptive Instruction In that It falls to adjust 
to Individual differences. If a given number of reinforcements produces dif- 
ferent degrees of response probability In different subjects during the early 
stages of learning. It seems reasonable to expect that a similar situation 
exists after frequency has reached asymptote. 

IWo other measures of response strength may be available at the time 
learning Is taking place: response amplitude and latency. Response amplitude 

would not appear to be a particularly relevant measure within the area of 
verbal learning but there are several Indications that latency may be quite 
useful as a supplement to frequency measures. Osgood (1953) points out that 
latency measures have the advantages of being applicable In a wide variety of 
situations, of providing a continuous trlal-to-trlal measure as opposed to 
the dichotomous measure of frequency and of retaining sensitivity after fre- 
quency measures have reached asymptote. The major disadvantage of latency 
measures Is their extreme variability between subjects and from trlal-to-trlal 
for the same subject. This variability may be so severe as to render latency 
measurements useless as a basis for Instructional decisions. The purpose of 
this study was to examine response latency behavior throughout the course of 
learning In a paired-associate learning task. A limited number of task vari- 
ables which may Influence the magnitude and variability of response latency 
were also Investigated. Special consideration was given to the effects of 
these variables on the sensitivity of latency to changes In response strength. 

Latency as a Measure of Response Strength 

Hull, In his Principles of Behavior (1943), stated that habit strength 
manifests itself In the length of the time elapsing from the onset of the stim- 
ulus to the onset of the associated response. This statement was based on a 
study of paired-associate response latency done by Slmley (1933). Slmley's 
results Indicated that latency decreased as a function of practice after the 
associative strength of the Items had reached the "threshold of recall." It 
was further shown that during the sequence of correct responses, latency was 
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a positive function of the number of promptings required to raise the strength 
of the association above threshold, i.e., of the number of trials before the 
first correct response. 

A similar experiment reported by Peterson (1965) obtained comparable 
results. Numerals were associated with a set of ten CC blgraus. Each sub" ■ 
ject received twenty trials but only those subjects who had ten successive 
errorless trials were evaluated. A significant decline in latency was found 
over the sequence of ten successive errorless trials. 

If response frequency and latency are both indices of associative 
strength, we should expect to find reasonablv« correlations between the two 
measures. Beck, Phillips, and Bioodsworth (1962) and Johnson (1964) pre- 
sented subjects with nonsense syllables previously scaled for association 
value by Archer (1960) and measured the latency of the subjects' first free 
associations. The obtained correlations ranged from -.19 to -.70. Johnson 
then constructed paired-associate lists in which the response items were 
the CVC trlgrams for which first-response latencies had been obtained. The 
obtained correlation between learning rate and Archer's a value (association 
value) was .41 while the correlation between learning rate and response la- 
tency was .36. The multiple correlation using both and latency as predlc- 
torq of learning rate was .57. 

It would appear that response frequency and latency may measure two 
relatively distinct factors, both of which are related to associative strength. 
The premise of two separate factors is supported by a study by Williams (1962) 
in which paired-associate lists were learned by the anticipation method. 
Knowledge of results was presented for either one or four seconds. The 
longer knowledge of results exposure caused a significant reduction in the 
number of trials required to reach criterion but did not produce a comparable 
reduction in response latencies. That is, the response frequency measure was 
altered but the latency measure was unchanged. 

Shlffrln and Logan (1965) hold that latency is not a measure of associa- 
tive strength but a defining property of different responses. That is, a fast 
response and a slow response to the same stimulus are actually two different 
responses, capable of being differentially reinforced. To demonstrate their 
point, the authors conducted a paired-associate learning experiment in which 
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mlniiauDi response latency was limited to either 0.75 or 2.85 seconds. After 
the subjects reached criterion, they were Instructed to Identify as many 
pairs as possible In two minutes, the next pair appearing Immediately fol~ 
lowing the subject's response. Under these conditions, the fast practice 

group nade significantly more responses than did the slow practice group. 

« 

It would appear that response strength Is only one of several factors 
which Influence latency, and If latency Is to be a practical tool for evalu- 
ating associative strength, these other factors must be Identified and sub- 
jected to experimental control.. This experiment was therefore concerned with 
Investigating both the relationship between learning and latency and factors 
othc : than learning which might Influence latency. 

Latency Trends During the Learning Process 

In the past few years a number of studies have Investigated response 
latencies throughout the course of paired-associate learning. The Impetus 
for conducting most of these studies has come from questions derived from 
Estes' one-trial learning models and from attempts to construct mathematical 
models of the associative learning process. As a result of the nature of the 
questions being asked, the data have been examined from new vie joints which 
have revealed trends of considerable Interest. These trends are discussed 
below. 

A new and useful technique for Investigating latency over the course 
of paired-associate learning Is to align all Item protocols on the basis of 
the trial of last error (TLE) . The TLE for a particular Item Is defined as 
the last trial on which an Incorrect response was made prior to the point at 
which that Item reached a criterion of n successive errorless trials In which 
n is some predetermined value. Item records are aligned so that the TLE 
serves as a point of origin from which all trials, both prior to and after 
the TLE, are counted. When such TLE-based protocols are averaged, the result 
Is analogous to a backward learning curve. All responses falling on a partic- 
ular TLE relative trial are representative of a similar stage of learning In 
that each Is equidistant from the point at which the criterion Is attained. 

Decrease In latency following the trial of last error . The manner in 
which Slmley (1933) evaluated his data made his analysis very similar to the 
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recent analyses which took the TLE as a point of origin. Simley's finding 
that latency declined rapidly after the TLE has been supported in all of 
the recent studies to be discussed below. 

Latency trends prior to the TLE . One of the first Investigators to 
use the technique of aligning protocols on the basis of TLE was Mlllward 
(1964) who used 12 two-digit numerals as stimuli in a 20 trial paired-assoc- 
iate learning task in which the required response was to press one of two 
buttons, six stimuli being associated with each button. The latencies on 
the first trial were relatively short, suggesting that the subjects simply 
guessed on that trial. Latencies Increased rapidly over the next few trials 
and then remained relatively constant until the TLE. After the TLE there 
was a rapid decrease in latency which did not appear to have reached asymp- 
tote after nine successive errorless tr.^*ils. 

Suppes, Groen and Schlag-Rey (1966) measured latencies in a paired- 
associate task in which the stimulus items were a set of 12 CVC nonsense 
trlgrams and the required response was to press one of three buttons. They 
found a very sharp rise in latency over the first few trials and concluded, 
as had Mlllward, that this was due to the subjects making random guesses on 
the initial trials. After this initial rise, both correct and Incorrect 
response latencies were relatively constant up to the trial before the TLE. 

Klntsch (1965) ran subjects in a paired-associate learning task in 
which stimulus items were 12 nonsense syllables with Glaze association values 
of .60 and the required response was to vocalize the numbers one or two. 

Klntsch 's results differed from those of Mlllward and Suppes et al. in that 
after the sharp initial rise, latencies continued to Increase somewhat as a 
function of trial number up to and including the TLE. 

Latencies of correct and incorrect responses . Related to the question 
of response latency stationarlty prior to the TLE is the question of the rela- 
tionship between correct and Incorrect response latencies. Suppes, Groen and 
Schlag-Rey (1966) specifically investigated this point and found no significant 
difference between the response speeds of correct and incorrect responses. 
Mlllward (1964) presented a plot of the latencies of correct and incorrect 
responses prior to the TLE. Of the eighteen trials at which comparisons may 
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be made* Incorrect response latency was longer than correct response latency 
fourteen times but the variability of both curves was so great that one 
cannot draw any firm conclusions. 

Eimas and Zeaman (1963) ran a "miniature experiment" in which sub- 
jects were given one practice trial during which they could examine the 
S-R pair as long as they wished. They were then given two test trials dur- 
ing which only the stimulus item was presented and no knowledge of results 
was given. This was followed by a second practice trial and two more test 
trials. Thf? stimuli consisted of 12 CCC trlgrams of high association value 
and the response elements were the numbers one through twelve. If the 
latencies of the response sequences consisting of four Incorrect responses 
are examined » it is noted that these response speeds are much slower than 
the latencies of correct responses on the corresponding trials. While this 
experiment was not directly comparable with the Suppes, Groen and Schlag- 
Rey experiment » it did suggest that correct and Incorrect response latencies 
may not always be equivalent. 

Latency as a function of learning rate . The purpose of Slmley's (1933) 
study was to demonstrate that the rate of learning below and above the 
"response threshold" is a function of the same factors. The rate of learn- 
ing below threshold was measured by the number of promptings required before 
the subject could provide the correct response while learning rate above 
threshold was held to be indicated by the decrease in response latency as 
a function of practice following the point at which the correct response 
reached threshold. Slmley concluded that he had demonstrated his point 
since the data for each of the three subjects discussed clearly showed that 
response latency during overlearning was a positive function of the number 
of trials required to reach threshold. Items which were learned slowly had 
higher latencies during overlearning. This result was even more pronounced 
when the recent innovation of comparing trials equally distant from the TLE 
was applied to the data. The more difficult items » as defined by the number 
of trials required to reach the TLE, had longer response latencies even when 
the items were equated as to the number of trials of overlearning. 

This same effect was found in the data presented by Suppes, Groen and 
Schlag-Rey (1966). When mean response times were correlated with item 
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difficulty (■••■urud in terns of the number of trials required to reach the 
TLE) the Speaman rank difference correlation coefficients for the two ex- 
perimental sessions discussed were ,68 and ,77, both significant at the ,01 
level. In contrast, mean response time after the TLE was unrelated to item 
difficulty in the data presented by Klntsch (1965), Mlllward (1964) noted 
that in his data, latency was in general a positive function of the number 
of trials required to reach the TLE throughout the learning task. He attrib- 
uted this to the fact that slow learners would require more trials to reach 
the TLE and postulated that slow learners may have longer response latencies 
than fast learners. This hypothesis was not evaluated in the article, and 
the raw data were not made available. While it may well be that slow learners 
are slow responders^ it must be noted that Simley found the same relationship 
between item difficulty and response latency within individual subjects. 

Mlllward 's results do offer the interesting suggestion that latency 
may be a positive function of item difficulty prior to the TLE when level 
of learning is held constant by equating the number of subsequent trials re- 
quired to reach the TLE. This suggestion was supported by the Suppes, Groen 
and Schlag-Rey study. When subgroups were ranked according to item difficulty 
and the subgroups' mean latencies for correct responses prior to the TLE were 
also ranked, the Spearman rank difference correlation coefficients for the 
two sessions were .71 and .69. 

Latency on the TLE . The trial of last error Itself may have interest- 
ing properties. Suppes, Groen and Schlag-Rey (1966) found that, in general, 
response latency on the TLE was considerably longer than either the preceding 
error latencies or the preceding success latencies. The frequency with which 
the TLE latency was greater than either the immediately preceding or subse- 
quent response latencies was significantly greater than chance. The authors 
pointed out that the same phenomenon was to be found in Klntsch 's (1965) data 
and in an unpublished study by W. K. Estes and D. Horst. 

First correct response latency and subsequent errors . A paired-associate 
learning experiment reported by Williams (1962) used a list of 25 pairs of four 
letter words. His analysis of the latency data was based on the trial of the 
first correct response for a given item as opposed to the trial of last error. 
Latency data were presented for the trial of the first correct response and for 
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the ninth trial thereafter. Item sequences were classified into two groups 
on the basis of whether or not incorrect responses were made following the 
first correct response. Latency measures for item sequences containing in- 
correct responses declined from 2.02 to 1.50 seconds while the sequences of 
all correct items declined from 1.87 to l.AO seconds. The decline in laten- 
cy over the nine trials is in agreement with the data previously discussed. 
The more interesting finding was that first correct response latencies were 
longer if the subject made subsequent errors. This is in agreement with the 
conception of response latency as an index of associative strength. If the 
associative strength were relatively low at the time of the first correct 
response • we would expect the response latencies to be longer and we would 
also expect that there would be a higher probability of one or more subse- 
quent Incorrect responses. 

This explanation is contradicted, however, by the previously dis- 
cussed Elmas and Zeaman (1963) experiment. To test the hypothesis that 
correct response latency is indicative of response strength, Eimas and 
Zeaman classlflfed all items answered correctly on test trial one as either 
fast or slow. The slow items were not recalled particularly slowly on test 
trial two nor did they tend to be recalled Incorrectly. Instead, they showed 
a significantly greater Increment in speed on test trial two than did the 
items classified as fast on test trial one. 

S^—miiry of latency trends . These recent studies of latency trends 
during paired-associate learning have raised questions of Interest in five 
different areas. First, what is the nature of the latency curve prior to 
the TLE? Is there always a sharp initial rise following the first, relatively 
fast responses? After the occurrence of such a rise, if any, do response 
latencies remain constant or do they continue to Increase up to the TLE? 

Secondly, there is the question of whether or not response latency, 
on a given pre-TLE trial, is a function of the correctness of the response. 

Third, there are several questions concerning the relationship of re- 
sponse latency to item difficulty and/or individual differences in learning 
rate. Is latency during overlearning a function of the number of trials re- 
quired to reach a criterion of errorless responding? Does this relationship 







hold during the early stages of learning, prior to the TLE? If these effects 
do exist, are they attributable solely to Item difficulty or are they also a 
function of Individual differences In learning rate? 

Fourth, Is the occurrence of maximum response latency on the TLE a re- 
liable phenomenon? 

Finally, does the response latency of the first correct response to a 
given Item predict the probability of occurrence of subsequent errors on that 
Item? 

Methods of Item Presentation and Response Measurement 

The most troublesome problem In attempting to use latency measurements 
as predictors of single Item response sequences for Individual subjects may 
be latency's large trial- to- trial variability. In his Investigation of re- 
sponse latencies after the TLE, Peterson (1965), using an anticipation pro- 
cedure, was unable to determine the presence of any systematic trends In the 
latency data prior to the TLE and suggested that the variability appeared to 
be so great as to render any attempt at analysis futile. He postulated that 
at least a partial cause of the high degree of variability might be Interfer- 
ence effects due to Incorrect responses and suggested that the Interference 
might be alleviated by using a recall paradigm. 

Faster learning under a recall paradigm, as contrasted with an antici- 
pation paradigm, has been demonstrated In a series of experiments conducted 
by Battlg (Battlg and Brackett, 1961; Battlg and Wu, 1965). In general It 
was found that recall procedures resulted In a consistently higher percentage 
of correct responses per trial and required fewer trials to reach criterion. 
Battlg and Brackett suggested that recall procedures may be superior due to 
their separation of the two behavioral processes of producing a previously 
learned correct response and learning new S-R associations. 

If the temporal contiguity of the associative and response production 
processes does produce Interference effects which retard the rate of learning. 
It would appear quite likely that these effects would also tend to Increase 
the magnitude and variability of response latencies. If the use of a recall 
paradigm does reduce these Interference effects, the variability of response 
latency during the early stages of learning should be reduced. 
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Dls.lunctlv Reaction Time 

If one is interested in detergulnlng the variables which Influence 
latency in a verbal learning task, one of the most fertile related areas 
of investigation would appear to be the study of choice or disjunctive re- 
action time (DRT) . If viewed in the context of information theory, it be- 
comes evident that the behaviors required in a paired-associate learning 
task and in a DRT task are similar forms of information processing. The 
major difference is that the S-R associations are well known tc the subject 
in the DRT task while they must be learned in the paired-associate task. 
Once the strength of the S-R associations has risen above "threshold," the 
two tasks become quite similar. Since the latency of responses which occur 
after the point at which the frequency measure has reached asymptote, that 
is, after the TLE, may be of special Interest, it would appear to be worth- 
while to examine the relevance of the findings of the DRT studies to paired- 
associate learning. 



For almost 70 years following the work of Merkel (1885) , the general- 
ization was widely held that DRT was some positive function of the number of 
response alternatives. With the application of information theory to the 
study of reaction time, the proposition was refined to a quantitative state- 
ment. Hyman (1953) drew an analogy between a DRT task and a model of a 
communications system. In this analogy, each alternative stimulus or sig- 
nal is a message. The greater the nimiber of alternative messages possible, 
the greater is the uncertainty as to which message will be transmitted. Thus, 
when a given message is transmitted, the reduction in uncertainty is a posi- 
tive function of the number of possible alternative messages. The amount of 
information transmitted is defined as the amount by which the uncertainty is 
reduced. The information value (h.) of a particular message (1) is given in 
units of "bits" as being equal to the log 2 where p^^ is the probability of 
occurrence of message 1. When all messages or stimuli have an equal proba- 
bility of occurrence, the formula may be simplified to H « log 2 n, where n 
is the number of possible messages. 



Hyman varied the amount of information in the stimulus display in a 
DRT task which had a one-to-one correspondence between stimuli and responses 
and concluded that DRT is a positive linear function of the number of bits 













1 










11 



of information in tha atimulus display* A previous study by Hick (1952), 
however, had shown that this relationship did not hold if the subjects were 
allowed to make errors. Subsequent studies by Brlcker (1955) and Rabbitt 
(1959) supported Merkel's original contention that it is the number of the 
response alternatives and the relative probability of any particular re- 
sponse which Influences DRT. The currently accepted function is DRT “ 

a *f b H • where H is the amount of Information, expressed in bits, trans— 
t t 

mltted by the subject per S-R event. 
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Definition of the Problem 



While the recent studies concerning the attributes of response la- 
tency during the course of learning have Interesting Inpllcatlons for 
latency as a basis for Instructional decisions, the findings have not been 
sufficiently consistent to allow one to state, with any degree of certainty, 
hypotheses concerning the factors which underlie these phenonena. It ap- 
pears that the effects of associative strength on response latency are rel- 
atively complex and dependent on a number of task related variables which 
are unrelated to learning per se. While this experiment was concerned with 
systematic changes In latency during the course of learning, equal consid- 
eration was given to parametric Investigation of task variables whldh were 
considered likely to Influence the relationship of latency and learning. 

If the task variables which Influence latency can be Identified and brought 
under experimental control, the Investigator will be In a much stronger 
position to evaluate the functions relating latency to associative strength. 

TWo such task variables were Investigated. The anticipation and 
recall paradigms were compared and the effects of Information transmission 
were explored by varying the amount of Information required for errorless 
responding. Within the context of the parametric Investigation, several 
questions were asked concerning systematic changes In response latency as 
a function of learning In a paired-associate task. 

Response Latency as a Function of Training Method 

As was previously discussed. In ter- response variability In response 
latencies presents a probem for any attempt to Investigate the factors under- 
lying latency behavior or to use latencies as a basis for Instructional de- 
cisions. This Is particularly true during the early stages of learning, prior 
to the TLE. Peterson (1965) suggested that the variability In pre-TLE re- 
sponse latencies In a paired-associate learning task may be at least par- 
tially due to Interference effects deriving from the nature of the anticipa- 
tion paradigm training method. It was further suggested that the Interfer- 
ence effects might be eliminated or at least reduced by the use of a recall 
paradigm. The anticipation and recall paradigms were therefore contrasted 
and It was hypothesized that response latencies prior to the TLE would be 
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shorter and less variable under the recall paradigm than under the anticipa- 
tion paradigm. In addition, the magnitude and variability of response la- 
tencies after the TLE were contrasted under the two paradigms although In 
this case, no specific hypotheses were formed. 

Response Latency as a Function of Information Transmission 

As was pointed out In the Introductory section on disjunctive reac- 
tion time, a subject's behavior during the overlearning phase of a paired- 
associate learning task Is very similar to the behavior required of a sub- 
ject In a DRT task. It was also shown that DRT Is, In general, a positive 
linear function of the number of bits of Information transmitted by the 
subject per S-R event. It seemed quite likely, therefore, that response 
latency after the TLE would be a positive function of the amount of Informa- 
tion transmitted. Since the subject's performance was essentially errorless 
during this period, the amount of Information transmitted was equal to the 
log2 of the number of response alternatives. IWo, four, or eight equally 
probable response alternatives corresponded to the transmission of one, two, 
or three bits of Information respectively. 

There was a possibility that response latency prior to the TLE would 
also be related to the amount of Information transmitted. Due to the oc- 
currence of errors, Information transmission was not directly related to 
the number of response alternatives but it was considered that the relation- 
ship might be sufficient to have some Influence. It was therefore hypothe- 
sized that response latencies prior to the TLE would Increase as some func- 
tion of the number of response alternatives. 

Response Latency as a Function of Learning 

The recent studies of response latency during the course of paired- 
associate learning have several implications of relevance to Instructional 
decisions based on response latency. Previous research has, however, resulted 
In conflict on several points, and It appeared that further Investigation 
would prove to be fruitful. The current experiment attempted to answer a 
number of questions concerning systematic changes In latency during the 
course of learning. This was done within the context of the parametric In- 
vestigation of task variables discussed above. The five points Investigated 
are described below. 
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i® the nature of the function relating latency to practice prior 
to the TLE? Mlllward (1964) and Suppea, Groen and Schlag-Rey (1966) found 
a sharp Initial rise on the first few trials but latency then remained rela- 
tively constant until the TLE. Klntsch (1965), on the other hand, found a 
steady Increase In latency up to and Including the TLE. 

Do correct response latencies differ from Incorrect response latencies 
the TLE? Suppes, Groen and Schlag— Rey found no difference between 
these latencies but data from Elmas and Zeaman (1963) Indicate that under 
some conditions. Incorrect responses are slower than correct responses. 

Is latency before and/or after the TLE a function of learning rate 
as defined by the number of trials required to reach the TLE? This effect 
was found after the TLE In the data presented by Slmley (1933), Mlllward, 
Klntsch and Suppes et ja. It was found prior to the TLE In the data ob- 
tained by Mlllward, Klntsch, and Suppes, Groen and Schlag-Rey. Is this ef- 
fect a between subjects variable (slow learners are slow responders) as 
suggested by Mlllward or a within subjects variable (difficult Items have 
long response latencies) as suggested by Slmley 's data? 

Is response latency on the TLE reliably greater than the latency 
of immediately preceding Incorrect responses or Immediately subsequent 
correct responses? Abnormally long latencies on the TLE were found In 
the data presented by Suppes, Groen and Schlag-Rey, and Klntsch. Mlllward 
did not find the phenomenon. 

Is the latency of the first correct response to an Item longer If 
the subject makes subsequent errors on that Item? Williams (1962) reported 
that this was the case but his findings were contradicted to some extent by 
the data reported by Elmas and Zeaman (1963). 

Summary of Hypotheses and Experimental Questions 

It was hypothesized that an anticipation procedure, as compared with 
a recall procedure, would result In longer and more variable latencies. 

(1) The variance of response latencies prior to the TLE would be 

greater under the anticipation procedure than under the recall 
procedure . 
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(2) Prior to the TLE, response Istencles would be longer under an 
anticipation procedure than under a recall procedure. 

(3) What are the relative effects of the anticipation and recall 
procedures on response latencies subsequent to the TLE? 

It was hypothesized that latency would be a positive function of the 
number of bits of information which a subject is required to transmit. 

(1) Response latency prior to the TLE would be an increasing function 
of the number of response alternatives. 

(2) Response latencies subsequent to the TLE would be an Increasing 
linear function of the log^ of the number of response alternatives. 

The effects of learning on latency were studied by investigating the 
following questions under each of the experimental conditions. 

(1) What is the general relationship of latency to practice prior to 
the TLE? 

(2) Do the latencies of correct responses differ from the latencies of 
Incorrect responses during practice prior to the TLE? 

(3) Are the response latencies of individual subjects a positive func- 
tion of item difficulty for those subjects? Is this effect found 
both prior to and after the TLE? 

(A) Are the mean response latencies of different subjects an Inverse 
function of the learning rate of those subjects? Is this effect 
found both prior to and after the TLE? 

(5) Is response latency on the TLE greater than the latency of an imme- 
diately preceding Incorrect response? Is response latency on the 
TLE greater than the latency of an immediately subsequent correct 
response? 

(6) Is the latency of the first correct response to an item longer if 
subsequent errors are made to that item? 
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Method 



The experiment consisted of 16 replications of a two by three fac- 
torial design. The two training methods, anticipation and recall, were con- 
trasted and three levels of Information transmission were Investigated by 
pairing two, four, or eight response alternatives with the members of an 
eight Item stimulus list. Different subjects were used In each of the six 
treatment groups. 

Subjects 

Subjects were drawn from the University of Pittsburgh's Introductory 
psychology classes during the fall and winter trimesters of the 1966-1967 
school year. Students In these classes were required to donate four hours 
of their time to being experimental subjects and were not paid for their 
services. A total of 103 subjects were run. Of these, six failed to com- 
plete the experiment as a result of equipment failures and one was rejected 
due to an error on the part of the experimenter. The remaining 96 sub- 
jects were evenly divided between males and females. Eight males and eight 
females were assigned to each of the six treatment groups. 

The subjects were not given a formal vision test but were required 
to read the stimuli aloud during the first trial of the warm-up task. No 
subject experienced difficulty In correctly Identifying the stimuli. 

Materials 

The stimuli used In the tasks were CVC trlgrams of 20 to 30 per cent 
association value as determined by Archer (1960). The four trlgrams VAH, 
VAQ, VEH, and VOZ were used In the warm-up task. The main task stimulus 
list was ZAB, ZAP, ZEF, ZEG, ZIK, ZIX, ZOK, and ZOX. These stimuli were 
selected so as to be highly similar In terms of the composition and place- 
ment of the letters. 

The responses to be associated with the above stimuli were key posi- 
tions on a response panel. As was previously discussed, subjects were re- 
quired to associate two, four or eight key positions with the eight stimuli. 
This corresponded to the transmission of one, two or three bits of Informa- 
tion when all of a subject's responses were correct. 
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Apparatus 

The experiment was controlled by the Learning Research and Develop- 
ment Center's Computer Facility. This is an on-line, time shared system 
using a Digital Equipment Corporation, PDP-7 digital computer. The system 
presented the stimuli and knowledge of results, processed the subject's 
responses, maintained records of each subject's progress and timed response 
latencies and interitem Intervals. Response latencies were measured with 
an accur£\cy of ^ 0.001 seconds. All other timing was controlled to within 
^ 0.02 seconds. A complete record of each subject's stimuli, responses 
and response latencies was punched out on paper tape during the course of 
the experiment. These paper tapes were fed back Into the computer and a 
limited amount of data reduction was done while the next subject was being 
run. The output of this data reduction program was a printed summary of 
each subject's record. 

The stimulus trlgrams were presented on the screen of a cathode ray 
tube three Inches high by four Inches wide. The trlgram letters were all 
upper case. Each letter was generated as a set of points selected In a 
seven by five point matrix. The letters were one-half Inch high by three- 
eighths Inch wide. The screen of the tube was positioned 20 Inches In 
front of the subject, at eye level. 

Subjects were required to Indicate their responses by pressing but- 
tons mounted on one of three response panels. The panels were 15 1/2 
Inches wide by 15 Inches deep and sloped upwards on an angle of 20 degrees. 
They rested on a table In front of the subject and could be moved about to 
maxlmlne ease of responding. Two, four, or eight push-button mlcroswltches 
were mounted at the top of each panel to correspond to the three levels of 
Information transmission. The pushbuttons had one-half Inch diameter caps 
which extended one-half Inch above the panel. A force of five ounces over 
a distance of one-eighth Inch was required to actuate the switches. 

On all the panels, the switches were mounted on a semicircular arc 
with a two Inch radius. This allowed a center to center distance of three- 
quarters of an Inch between the switch caps on the eight key panel. The 
switch caps were not numbered or otherwise Identified for the subjects. 





Fig. 1. Full Scale Diagraii of Response 
Positions for Infoimation Level Three. 
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The keys were assigned arbitrary numerical Identities for the purpose of 
program control and response recording but the subjects had no access to 
this Information, The Identities of the keys are Illustrated by the dia- 
gram of the eight key panel In Figure 1. On the four key response panel, 
keys 1 through 4 were located In the same positions as the correspondingly 
numbered keys on the eight key panel. Only keys 1 and 2 were present on 
the two key response panel. This arrangement assured that keys 1 and 2 
were In the same relative position on all three response panels and that 
keys 3 and 4 were In the same positions on the two more complex panels. 

The correct response keys were Indicated by Illuminating a red 
pilot lamp next to the correct key. A white ring marked the center of the 
arc on which the switches were mounted. The subjects were Instructed to 
respond with the Index finger of their preferred hand and to keep their 
finger on the ring between responses. A buzzer was used to warn subjects 
at the start of a test trial and to Indicate the end of a task. An Inter- 
office telephone enabled the subject to contact the experimenter when the 
subject finished the experiment or In the case of unforseen problems. 

Randomization Procedures 

The experiment consisted of 16 replications of the three by two 
factorial design. The order In which the treatment conditions were ad- 
mlnlstere/1 within each replication was predetermined by reference to a 
random number table. When a subject arrived at the laboratory, he was 
assigned to the next available treatment condition In the replication 
currently assigned to his sex. 

The assignment of responses to stimuli was varied randomly over 
the 16 replications. Within a single replication, an attempt was made to 
keep the stimulus-response assignments the same across the six treatment 
groups. Perfect correspondence was not possible since the different In- 
formation level treatment groups had different numbers of response alter- 
natives but as close a correspondence as possible was maintained. Table 1 
Illustrates a typical example of response assignments. 

The order of Item presentation during each trial was controlled by 
systematic reference to a table of randomly determined orders. The 
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TABLE 1 

Example of Stlaulus-Responae Asslgnatnta 



Nuabar of Raaponaa Altarnatlvaa 



Stimuli 


2 

Responses 


4 

Responses 


8 

Responses 


ZAB 


1 


1 


1 


ZAF 


2 


2 


2 


ZOX 


1 


3 


3 


ZE6 


2 


4 


4 


ZIK 


1 


1 


5 


ZOK 


2 


2 


6 


ZEF 


1 


3 


7 


ZIX 


2 


4 


8 



randoanaaa of tha ordara waa conatralnad to tha axtant that tha aaoia Itaa 
waa navar praaantad twlca in auccaaalon by balng the laat Itan on ona trial 
and tha flrat Itaa on tha naxt trial. All aubjacta raapondad to itana in 
tha aana ordctr undar both tha anticipation and racall procaduraa. Tha aa- 
quenca of ordara waa rapaatad once every thirty triala. 

Experimental Procedure 

Subjacta ware run ona at a time. After tha inatructiona ware given, 
the subject waa alone in tha room but could be observed through a one-way 
vision window. The computer control system was located in a separata room. 
Information concerning tha particular axparlmental treatment which a subject 
was to receive was loaded into tha computer and the system was placed in a 
waiting mode before tha subject was brought into tha laboratory. After tha 
subject was seated at the console, he was given typical paired-associate 
learning task instructions which ware varied as little as possible between 
the anticipation and racall procedures. Tha experimenter then started the 
experiment from the subject's console. He remained with the subject until 
he was sure that the subject understood what was required of him and then 
left the room. 

All the experimental conditions Included a warm-up period. During 
this period, the subjects were trained by the aame method (anticipation or 
recall) that they would experience in the main task. They also used the 
same response panel with two, four, or eight buttons that they would use in 
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the main task. The training list consisted of only four Itema which were 
always associated with buttons 1 and 2 regardless of the number of buttons 
on the subject's response panel. 

The warm-up task was paced by allowing the subjects only three sec- 
onds in which to respond following the presentation of the stimulus. Failure 
to respond was counted as an error. Response times were unlimited during the 
main task. This procedure was intended to deter the subjects from adopting a 
strategy of rehearsing each item a number of times before proceeding to the 
next item. Response times were unlimited in the main task to prevent the oc- 
currence of a truncated latency distribution. As far as it was possible to 
determine, this strategy was successful. 

In both the training task and the main task, subjects were drilled until 
they reached a criterion. This was not the usual criterion for the entire list 
but a criterion for each of the items in the list. Response records were main“ 
talned fr^r the individual items. When a series of six successive errorless 
trials was completed for a given item, the control program noted that that item 
had reached criterion. The program continued to present the item on subsequent 
trials but the occurrence of errors was irrelevant to how long the drill was 
continued. Drill on the list was terminated a set number of trials after the 
trial on which the last item reached criterion. This final drill period was 
two trials long in the training task and ten trials in the main task. The 
trial prior to the first trial in the series of six successive errorless trials 
was designated the trial of last error (TLE) for that item.. This schedule for 
determining the point at which drill was terminated assured that all items 
would have at least 16 trials after the TLE. The procedure did not assure the 
absence of errors after the TLE but Suppes, Groen and Schlag— Rey (1966) noted 
that the few Incorrect responses which did occur after items had reached a 
similar criterion appeared to be careless mistakes, the latencies of which 
were consistent with the short latencies of well learned responses. 

The experimental conditions of the anticipation and recall procedures 
were equated as far as possible. Under the anticipation procedure, the onset 
of a 0.5 second auditory warning signal occurred 1.5 seconds before the begin- 
ning of a trial, where a trial was one presentation of the complete list. The 
stimulus item was presented and remained on the screen until the occurrence of 
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the subject's response (or for e Bsxlmum of three seconds in the wam-up 
task). The pilot laap next to the correct key was then lllisilnatcd. The 
word on the screen and the light stayed on together for two seconds. The 
screen was then erased and the light was turned off at the sane time. After 
a 1.5 second Interltem interval, the next word was presented on the screen. 
Successive list presentations were separated by a four second Intertrlal in- 
terval and the warning buszer always preceded the first Iten of each trial 
by 1.5 seconds. 

The recall procedure Incorporated successive training and testing 
phases within each trial. During the training phase, each trlgram-llght 
pair was presented together for two seconds. Following each presentation, 
the screen was erased and the light was turned off for a 1.5 second Inter- 
ltem interval. At the tine of the end of the presentation of the last 
trlgram-llght pair in the training phase of the trial, the warning buzzer 
was turned on for 0.5 second. The first trlgran in the test phase was pre- 
sented on the screen 1.5 seconds after the onset of the buzzer. During 
the test phase, the stimulus item remained on the screen until the subject 
responded (or for a maximum of three seconds in the warm-up task). The 
screen was then erased and remained blank for a 1.5 second interltem inter- 
val. No knowledge of results was given during the test phase of the trial. 
Following the completion of the test phase, the screen remained blank for 
a four second Intertrlal Interval. The warning buzzer was not used to 
signal the start of the training phase of the next trial since the purpose 
of the buzzer was to warn the subject to get set to respond. 

Statistical Procedures 

In general, the experiment was a factorial design with two levels of 
training procedure (anticipation and recall paradigms) and three levels of 
information transmission requirements (two, four, and eight response keys cor- 
responding to one, two, and three bits of information). In addition, a third 
factor relating to a specific question such as the relative latencies of cor- 
rect and Incorrect responses, was usually Involved. Training procedure and 
number of response alternatives were both between subjects variables. The 
third factor was either a between or within subjects variable, depending on 
the nature of the specific question. 



23 



The relative position of the keys on the response panel raised a 
problem of experimental control. It was considered a definite possibility 
that since they had relatively distinctive positions, the keys on the two 
key response panel and the end keys on the four and eight key response 
panels might be subject to a serial position effect* That Is, Items for 
which these keys were the correct responses might be learned more quickly 
than the Items for which the responses fell Into the middle of the key 
array. In addition, it was considered likely that the perceptual-motor 
task of locating and pressing a key which was distinctive in that it was 
Isolated or at the end of the line of keys might be faster than an equally 
veil learned response to one of the keys in the middle of the key array • 

It was in fact found that items for which the correct responses were 
the end keys in the four and eight key tasks had shorter latencies and re- 
quired fewer trials to reach the TLE as compared with keys in the middle of 
the array. While this finding per se was not relevant to the points under 
investigation, it suggested that the two key task might be qualitatively 
different from the four and eight key tasks and that within the latter 
tasks, the different responses might not be analogous. If this were the 
case, the specific relationship under investigation might be a function of 
key position and information derived from an analysis which treated the 
data from all keys as homogeneous might be misleading. For this reason, 
two subtasks were defined across the two information levels* Items for 
which the correct responses were keys 1 or 2 were considered to be analo- 
gous across all three Information levels and likewise. Items for which the 
correct responses were keys 3 or 4 were considered to be analogous across 
the two higher order information levels. The questions of Interest could 
then be evaluated within these subtasks. 

For each experimental hypothesis or question to which this problem 
was considered relevant j a preliminary analysis of variance (ANOVA) was con- 
ducted which Included key position as an additional within subjects variable. 
Key positions 1 and 2 were contrasted with key positions 3 and A. Since 
keys 3 and A were not present in the two response alternative task, this 
analysis considered only data which derived from the four and eight response 
alternative tasks. Data from keys 5 through 8 in the eight response task 



were not Included in the analysis. The question of Interest in this analy- 
sis was not whether latency varied as a function of key position but whether 
there was any significant interaction between the key position variable and 
the variable of interest in that particular analysis. Such an interaction indi- 
cated that either the variable in question or some interaction of that variable 
with the information level or method variables was a function of key position. 

When such an interaction was found* two separate analyses of the data 
were conducted; the first covering keys 1 and 2 for all three information 
levels and the second covering keys 3 and 4 for only the two higher order in- 
formation levels. If no interaction was found* only one analysis* covering 
all key positions and all information levels* was conducted. 

Since the failure to find a significant interaction in this prelimin- 
ary ANOVA would result in ignoring possible differences between key positions* 
an alpha error was considered to be of smaller consequence than a beta error. 

For this reason* a high probability level of 0.10 was selected as a signifi- 
cance criterion for the preliminary* key position ANOVA. 

Subjects were run until all items had received at least 10 trials 
after reaching the criterion of six successive errorless trials. This as- 
sured at least 16 observations for each item for each subject after the TLE 
but there was no way to control the number of observations prior to the TLE. 

For this reason* all the analyses which dealt with data prior to and includ- 
ing the TLE suffered from missing data. Rather than attempt to compensate 
for the missing data statistically* observations were discarded until the 
number of observations in each treatment group equalled the number of scores 
present in the treatment group containing the fewest observations. The use 
of such a procedure might not be considered completely legitimate since 
scores would be dropped on a random basis from those groups containing a 
larger number of observations but dropped selectively from the treatment 
groups with the smallest number of available scores. There appeared to be 
no obvious cases in which the data might be biased due to this selection* 
but the reader should remain cognizant of the fact that the procedure was 
technically questionable. 

The latency scores were positively skewed but the normal procedure of 
using a reciprocal transformation (Edwards* 1962) was not completely 
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satisfactory. In some cases, e.g., when the scores were means of large num- 
bers of observations, reciprocally transformed scores tended to form a rec- 
tangular or blmodal distribution. Therefore, frequency histograms were 
plotted for the data in each analysis using several different transforma- 
tions. The transformation which yielded the distribution most normal in 
appearance was used in the ANOVA for that problem. The square root, log, 
and reciprocal transformations were evaluated. The histograms were plotted 
on the University of Pittsburgh IBM 7090 computer using a modified version 
of the U.C.L.A. Bio-Medical statistics program BMD(05D) (Dixon, 1965). 
Transformed data were used only in the statistical tests. Data presented in 
tables and graphs are raw score means in units of milliseconds. Almost all 
of the statistical tests employed were anlayses of variance of either a 
straight factorial design or a factorial with split plot design. All ANOVAs 
were run on the above mentioned computer using the BMD(02V) program (Dixon, 
1965). For the statistical tests which were directly concerned with the ex- 
perimental hypotheses and questions, as opposed to the key position variable 
tests, the significance criterion selected was 0.05. 
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Results 

The first and second sections of this chapter deal with general 
latency behavior over the course of learning. The third and fourth sec~ 
tlons are concerned with the effects of the experimental variables of 
training method and Information transmission requirements on response 
latency. The remaining sections present data relevant to several spe- 
cific relationships between learning and response latency . 

Data pertinent to each of the experimental hypotheses and questions 
are summarized in a series of tables. The tables contain the means » in 
milliseconds, of the relevant treatment groups and a summary of the rele- 
vant analysis of variance. Each of the different analyses had its own 
particular data reduction procedures and these are explained in the text 
accompanying each table. 

Throughout the tables, the convention has been adopted of using 
the Initials I and M to refer to the information level and method vari- 
ables In notation representing Interactions. Additional Initials have 
been used where appropriate. 

Changes In Latency over the Course of Learning 

Figure 2 Illustrates the relationship between correct response 
probability and response latency over the first 33 trials of the main 
task. All experimental treatment conditions have been grouped together. 
Correct response probability Increased as the usual negatively acceler- 
ated function and approached an asymptote at about 98 per cent correct. 

Over the same period, response latency rose slightly over the first few 
trials and then began a decline which continued through trial 20. The 
reliability of the data points represented by the curves decreases after 
trial 16 since the training period terminated for different subjects at 
different points after this trial. 

Figure 3 Illustrates these same relationships with the protocols 
alllgned on the basis of the TLE. Again, all experimental treatment con- 
ditions have been grouped together. Both the latency and response proba- 
bility curves are unreliable in the extreme left-hand portion of the figure 
since relatively few protocols were available to determine the points on 
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Fig. 2. Correct response probability and 
response latency as a function of trial number 
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the curves. Twenty five percent of the data or 192 responses are represented 
on trial TLE-8.^ This percentage increases until all of the 768 responses 
are represented in the data points on trial TLE+1 and all trials thereafter. 

Correct response probability Increased from what would be expected 
by chance on trial TLE-11 to 54 percent correct on trial TLE-1. Correct re- 
sponse probability was, of course, zero on the TLE and one on trials TLE+1 
through TLE+6 since the criterion for defining the TLE was six successive 
errorless trials. Error rate on trials TLE+7 through TLE+16 was never great- 
er than four percent but this was still somewhat higher than had been ex- 
pected and suggested that the criterion of six successive errorless trials 
may have been insufficient. 

In general, response latencies remained fairly constant prior to the 
TLE and then decreased in a negatively accelerated curve which did not appear 
to have reached an asymptote at the point at which training was terminated, 
at trial TLE+16. 

Latency prior to the TLE . Mlllward (1964) and Suppes, Groen and Schlag- 
Rey (1966) noted that the latency of the first response to an item was short 
relative to the next few trials. These observations were made under an antic- 
ipation paradigm in which the subjects were simply guessing on the first trial 
and it was suggested that the short initial latencies reflected this guessing 
behavior. In the current experiment, the first response latencies of the 
anticipation subjects were 146 msec, shorter than the corresponding responses 
of the recall treatment subjects who had already been shown one correct pairing 
of the items. This would appear to be indicative of the guessing behavior 
of the anticipation subjects. 

Figure 4 Illustrates changes in latency over the first eight trials of 
the experimental task. Mlllward and Suppes, Groen and Schlag-Rey also found 
that latencies Increased sharply over the first few trials. This was not a 
consistent finding in the current experiment. Four of the six treatment groups 
had shorter latencies on trial two than on trial one. Only the two more diffi- 
cult eight response tasks (information level 3) could be said to have demon- 
strated substantial Increases in latency over the early trials. For Information 



^Elght trials before the TLE. 
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levels one and two^ there was some tendency for the anticipation task laten*~ 
cies to increase but neither of the corresponding recall tasks demonstrated 
increasing response times over the early trials. 

Reference to Figure 3 illustrates that, in general, response latency 
prior to the TLE remained relatively constant. The curve may be somewhat 
distorted however, since as one moves from the left toward the TLE, an in- 
creasingly higher proportion of less difficult items is encountered and, as 
will be discussed later, the less difficult items tended to have shorter 
latencies. The curve, therefore, may not reflect the true relationship be- 
tween latency and practice prior to the TLE. 

To investigate this possibility, the following question was posed: 
does response latency change as an item receives practice prior to the TLE? 

It appeared reasonable to expect that a change in response latency would be 
more likely to occur and would be more meaningful for those items which had 
a substantial number of trials prior to the TLE. It was found that key 
position was not a relevant variable (F < 1.0) and all key positions were 
included in a single analysis. For each subject, the item which had the 
greatest number of trials prior to the TLE was selected. In the case of 
ties, the tied items were averaged together. Only items which had six or 
more trials prior to the TLE were considered and subjects who had no items 
with at least six pre-TLE trials were excluded from the analysis. Since, 
for the anticipation treatment groups, the initial response to each item 
was made before the subjects had observed the presentation of the correct 
S-R pair, the first trials of these groups were not Included in the criter- 
ion trial count nor in the analysis. 

The series of trials for each item was split into a first and second 
half. In a series containing an odd number of trials, the middle trial was 
randomly assigned to the first or second half. A mean was determined for 
each half of the trial series and these means comprised the scores which were 
examined as a within subjects variable In the analysis. 

The results of the analysis are presented in Table 2. Response la- 
tencies during the two halves of practice did not differ significantly. 

The table of means indicates that there was some tendency for the response 
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latencies to Increase, but this tendency was apparently not consistent. We 
nay conclude that, in general, response latencies renalned constant or in- 
creased slightly. There was definitely no reduction in response latency 
prior to the TLE. 

TABLE 2 

Pre-TLE Response Latencies as a Function of Practice 
Conparlson of the First and Second Halves of the Pre-TLE Trial Series 

All Key Positions 



Treatment Group Means 



Treatment 


N 


First Half 


Second Half 


Increase 


Information Level 


1 


12 


1488 


1673 


185 


2 


12 


1834 


1999 


165 


3 


12 


2050 


2522 


472 


Method 


Anticipation 


18 


1914 


2277 


363 


Recall 


18 


1668 


1853 


185 


Total 


36 


1791 


2065 


274 





Analysis of Variance 








(Reciprocal transformation) 






Source 


df 


SS 


MS 


F 


Between Ss Variance 


35 


21,094.08 






Practice 


1 


508.64 


508.64 


3.04 


“ I X P 


2 


0.52 


0.26 


< 1.00 


M X P 


1 


3.43 


3.43 


< 1.00 


I X M X P 


2 


227.92 


113.96 


< 1.00 


Within Ss Error 


30 


5,015.85 


167.19 




Total 


71 


26,850.44 







Latency after the TLE . Figure 3 indicated that response latency de- 
clined following the TLE. To evaluate this finding, post-TLE trial number 
was Incorporated as a within subjects variable in an ANOVA in which informa- 
tion transmission level and training method were between subjects variables. 
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Key position did not Internet with the trlsls vsrlsble (F < 1«0) end ell key 
positions were Included In a single analysis* The results of the analysis 
are presented In Table 3* Averaged across all treatment conditions , response 
latency decreased by 572 msec, from trial TLE+1 to trial TLE+16. This was a 
significant reduction. 

TABLE 3 

Response Latency after the TLE 
as a Function of 

Trial Number and Training Method 
All Key Positions 



Method 


N 


Treatment Group Means 
Mean Trial TLE4-1 


Trial TLE+16 


Decline 


Anticipation 


48 


1629 


1968 


1433 


535 


Recall 


48 


1323 


1744 


1135 


609 


Total 


96 


1476 


1856 


1284 


572 



Analysis of Variance 
(Reciprocal transformation) 



Source 


df 


SS 


MS 


F 




Information 


2 


156,354.69 








Method 


1 


78,791.26 


78,791.26 


22.23 


*** 


I X M 


2 


4,376.86 


2,188.43 


< 1.00 




Between Ss Error 


90 


318,996.79 


3,544.41 






Trials 


15 


58,715.13 


3,914.34 


33.62 




I X T 


30 


3,851.17 








M X T 


15 


7,035.26 


469.02 


4.03 


*** 


I X M X T 


30 


3,128.95 


104.30 


< 1.00 




Within Ss Error 


1350 


157,190.73 


116.44 






Total 


1535 


788,440.84 








*** p <,001 













Summarizing the changes In latency over the course of learning, we may 
state that following a possible Increase on the first few trials (the proba- 
bility and magnitude of which was dependent on the task characteristics) 



responsa latency remained relatively conatant prior to the TLE and then 
decreaaed aubatantially over the first 16 trials following the TLE. 

Intratrial Variability in Rasponae Latency 

Since variability in response latency has proven to be a problem 
in obtaining reliable latency measures (Peterson, 1965), variability was 
investigated under each of the experimental conditions and In the two 
major stages of learning, pre- and post-TLE. The scores obtained repre- 
sent variability in response latency within individual trials. For each 
subject, a standard deviation was calculated for each trial prior to and 
lncludlt£g the TLE for the last item to reach criterion. These intratrial 
scores were then averaged together to obtain a mean standard deviation for 
each subject. The same procedure was followed for the first 16 trials 
after the TLE. A summary of the group means is presented in Table 4. One 
subject in the second treatment group (information level 1, recall method) 
responded correctly to all the items on the first trial and had no subse- 
quent errors. Consequently, no pre— TLE data was available for this subject. 

The most striking feature of the scores in Table 4 is that the post- 
TLE standard deviations are consistently smaller than the pre-TLE scores. 

It will also be noted that the variability of the three information level 
groups Increased as a positive function of the amount of Information which 
the subject was required to transmit both prior to and after the TLE. 

The relationship of the standard deviation scores obtained under 
the two training methods was of special Interest since it had been hypo- 
thesized that recall variance would be less than the variance of latencies 
obtained under the anticipation paradigm. To test this hypothesis, a Mann- 
Whltney U test (Siegel, 1956) was conducted which compared the standard de- 
viation scores of the anticipation and recall treatment subjects both prior 
to and after the TLE. Prior to the TLE, the test yielded a U that equaled 
the mean of the distribution. Absolutely no difference was detected between 
the two treatments. After the TLE, the majority of the recall treatment 
scores ^ere smaller than the anticipation scores. The test resulted In a 
^ score of 2.90. A score of this magnitude would occur by chance with a 
probability of only .004. It may be concluded that prior to the TLE, 



reaponie latency variability was not influenced by training 
method but after the TLE, variability was significantly less under the 
recall paradigm. 



TABLE 4 

Standard Deviation Scores 
Representing Intratrial Variability 
in Response Latencies 

All Key Positions 

Treatment Group Means 

Treatment Pre-TLE Trials Post-TLE Trials 

Information 



Level 


Method 


N 


0 


N 


a 


1 


Anticipation 


16 


792 


16 


431 


1 


Recall 


15 


716 


16 


351 


2 


Anticipation 


16 


1»322 


16 


642 


2 


Recall 


16 


1,078 


16 


440 


3 


Anticipation 


16 


1,339 


16 


927 


3 


Recall 


16 


1,769 


16 


782 


1 


e 


31 


755 


32 


391 


2 


e 


32 


1,200 


32 


541 


3 


e 


32 


1,554 


32 


854 


e 


Anticipation 


47 


1,151 


48 


667 


• 


Recall 


48 


1,198 


48 


524 


Total 




95 


1,174 


96 


595 


Response Latencv 


as a Function 


of Tralnlne Method 







The magnitude of response latency scores obtained under the anticipa- 
tion and recall paradigms was contrasted both prior to and after the TLE. It 



was anticipated that latency scores obtained under the recall paradigm would 
be smaller than the comparable scores obtained under the anticipation paradigm. 

Pro-TLE latency as a function of method . Key position was not a rele- 
vant variable (F*1.33, df*l» 40) and all key positions were Included in a single 
analysis. All pre-TLE response latencies (with the exception of initial responses 
to anticipation items) were averaged together to obtain a mean pre-TLE latency 
for each subject for whom pre-TLE data were available. At least 14 subjects 
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were evelleble in eech af the experluentel treetment groupe. Meen pre-TLE 
letency wee treeted me e between eubjecte verleble in e fectorlel ANOVA 
which examined the effects of both training method and information level. 
The reaiilta of this analyaia are given in Table 5. 

TAl^LE S 



The Effects of Information Transmission Levels 
and Presentation Methods on 
Response Latencies Prior to the TLE 

All Key Positions 



Treatment Group Means 



Treatment 




N 


Latency 


Information Level 


1 


28 


1506 




2 


28 


1972 


Method 


3 


28 


2384 


Anticipation 




42 


1926 


Recall 




42 


1983 


Total 




84 


1954 



Analysis of Variance 
(Reciprocal Transformation) 



Source 


df 


SS 


MS 


F 


Information 


2 


7,600.80 


3,800.40 


13.48 


Fiethod 


1 


0.25 


0.25 


<1.00 


““ I X M 


2 


810.88 


405.44 


1.44 


Error 


78 


21,986.67 


281.88 




Total 


83 


30,398.60 






*** p < .001 


t 









Pre-TLE latencies did not differ significantly as a function of 
training method. The two means representing the anticipation and recall 
treatmenta differed by less than 60 maec. It nay be concluded that response 
latency prior to the TLE was independents of the training method. 
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Po8t~TLE latency as a function of method * Key position was not a rel- 
evant variable (P*1.64, d£*l, 1960) and all key positions were included in a 
single analysis. Rather than grouping all post-TLE data together » the effects 
of post-TLE practice were evaluated by treating the first 16 post-TLE trials 
as a within subjects variable in a factorial ANOVA in which information level 
and method were between subjects variables. Since post-TLE practice was ex- 
perimentally controlled, data were available from all of the 96 subjects. 

The results of this analysis are presented in Table 3 on page 33. 

Mean post-TLE response latencies, averaged across the 16 trials, were 
300 msec, faster under the recall paradigm than under the anticipation para- 
digm. This difference was significant. In addition, there was a significant 
interaction between the method and trials variables. The effect of this inter- 
action may be seen in Figure 5. While post-TLE latency declined under both 
paradigms, the magnitude of the reduction was slightly greater (74 msec.) for 
the recall paradigm than for the anticipation paradigm* It will be recalled 
that prior to the TLE, response latencies did not differ as a function of 
training method. On the TLE Itself, the anticipation and recall treatment 
group means differed by only 10 msec. It was only after the TLE that recall 
latencies became substantially faster than the comparable anticipation laten- 
cies and the magnitude of this difference continued to Increase during over- 
learning . 

Response Latency as a Ftmction of Information Transmission Requirements 

It was predicted that response latency would be a positive, linear 
function of the number of bits of information which the subject was required 
to transmit. 

Pre-TLE latency as a function of information level . Key position did 
not Interact with the information level variable prior to the TLE (F < 1.0) 
and all response keys were therefore included in this analysis. Disregarding 
the initial response to anticipation items, the mean response latency prior 
to the TLE was calculated for each subject. A factorial ANOVA was conducted 
in which information level and training method were between subjects variables. 
A summary of the results of this analysis is presented in Table 5 on page 36. 
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Fig. 5. Response Latency of anticipation and recall 
method subjects as a function of post-TLE trial number. 
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Pre-TLE latency Increased as a positive linear function of the number 
of bits of potential information involved in the task, i.e., the amount of 
information which the subject was required to transmit for errorless respond- 
ing. This relationship was significant. Since pre-TLE responding had a 
high error rate, the subjects were actually transmitting less than the poten- 
tial information in the task but latency did appear to be a linear fimction 
of potential information rather than transmitted information. 

Since all key positions were included in this analysis, the question 
arises as to whether this trend was not simply the result of the higher order 
information levels having keys which resulted in longer latencies because of 
their position in the middle of the keyboard array. That this was not the 
case was demonstrated by the failure of the preliminary, key position ANOVA 
to find a significant interaction between the key position and information 
level variables. In addition, if the data from the end key positions (keys 
1 and 2) are examined, the three latency means corresponding to the trans- 
mission requirements of one, two and three bits of information are 1528, 2079, 
and 2323 msec., respectively. 

Post-TLE latency as a function of information level . The preliminary 
ANOVA which Incorporated key position as an additional variable found that 
after the TLE there was a significant interaction between the information 
level and key position variables (F * 36.28, df * 1, 1860). For the two bit, 
four response task, response latency was Independent of key position but for 
the three bit, eight response task, the inner key positions (keys 3 and 4) 
had longer latencies than the outer key positions (keys 1 and 2) . One analy- 
sis was therefore conducted for only keys 1 and 2 across all three information 
levels and a second analysis treated only keys 3 and 4 in the two higher 
order information levels. Data from keys 5 through 8 in the three bit, eight 
response task were discarded. Information level and method were between sub- 
jects variables in the factorial ANOVAs. Latency scores for each subject on 
each of the first 16 post-TLE trials formed a within subjects, trials vari- 
able. Summaries of the results of these analyses are presented in Tables 6 
and 7 and curves representing changes in latency over trials are Illustrated 
in Figures 6 and 7. 
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TABLE 6 

Response Lstcncy After the TLE 
ss s Function of 
Informstlon Trsnsnlsslon Levels 

Key Positions 1 end 2 Only 



Treetment Group Means 



Infomation 



Level 


N 


Mean 


Trial TLE+1 


Trial TLE^16 


Decline 


1 


32 


12AA 


1496 


1057 


439 


2 


32 


1369 


1555 


1261 


294 


3 


32 


1653 


2426 


1302 


1124 


Total 


96 


1422 


1826 


1207 


619 



Analysis of Variance 
(Reciprocal transformation) 



Source 


df 


SS 


MS 


F 


j^nformatlon 


2 


58,478.42 


29,239.21 


7.60 


Method 


1 


68,184.29 






1 X M 


2 


3,063.56 


1,531.78 


<1.00 


Between Ss Error 


90 


346,325.38 


3,848.06 




Trials 


15 


47,754.86 


3,183.66 


14.35 


" I X T 


30 


6,612.62 


220.42 


<1.00 


M X T 


15 


6,073.85 






I X M X T 


30 


6,588.81 


219.63 


<1.00 


Within Ss Error 


1350 


299,558.71 


221.90 




Total 


1535 


842,640.50 






*** p <.001 











Response latency Increased as a function of Information level for 
both sets of key positions and In both cases the ANOVAs indicate that these 
Increases were significant. If the mean latencies for keys 1 and 2 are ex- 
amined, the function relating latency to the number of bits of information 
transmitted does not appear to be linear. The Increase in latency as a 
result of moving from one to two bits of information is less than half the 
Increase resulting from moving from two to three bits. 
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TABLE 7 

Response Latency After the TLE 
as a Function of 
Information Transmission Levels 

Key Positions 3 and 4 Only 



Information 

Level 


N 


Treatment 

Mean 


Group Means 
Trial TLE+1 


Trial TLE+16 


Decline 


2 


32 


1377 


1686 


1181 


505 


3 


32 


1927 


2860 


1698 


1162 


Total 


64 


1652 


2273 


1440 


833 



Source 


Analysis of Variance 
(Reciprocal transformation) 

Af SS MS 


F 


Information 


1 


65,491.02 


65,491.02 


21.58 *** 


Method 


1 


69,439.47 






1 X M 


1 


1,735.52 


1,735.52 


<1.00 


Between Ss Error 


60 


182,100.10 


3,035.00 




Trials 


15 


48,036.99 


3,202.47 


11.71 *** 


I X T 


15 


3,360.00 


224.00 


<1.00 


M X T 


15 


9,733.34 






I X M X T 


15 


2,112.73 


140.85 


<1.00 


Within Ss Error 


900 


246,132.96 


273.48 




Total 


1023 


628,144.13 






*** p < .001 










The manner 


in which the function relating latency to 


information level 


differed for the 


two different sets of key positions may be 


seen by contrast- 


ing the magnitude of the increase in response 


latency from 


information level 



two to level three in the two analyses. For the end key positions, keys 1 
and 2, the effect of changing from four to eight response alternatives was to 
increase mean latency by 284 msec. For keys 3 and 4, which were internal com- 
ponents of the key array, the comparable effect was to increase the mean latency 



LATENCY IN MSEC. 



3000 



INFORMATION LEVEL 1 




POST-TLE TRIAL NUMBER 



Fig. 6. Post-TLE response latencies of information 
levels 1, 2, and 3. Key positions 1 and 2 only. 
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Fig. 7. Post-TLE response latencies of infor- 
mation levels 2 and 3. Key positions 3 and 4 only. 
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by 550 msec. The effect is else evident in the distance separating the 
curves representing information levels two and three in Figures 6 and 7. 

Figures 6 and 7 also indicate that the decline in response latency 
over the first few post-TLE trials was much greater for information level 
three than for the two lower order levels. This difference did not per> 
slat over the full 16 trials however. The information by trials interac- 
tion was not significant in either of the two analyses. 

Pre-TLE Latency of Correct and Incorrect Responses 

Prior to the TLE, 45 percent of the responses were correct. For 
each subject, the mean pre-TLE latencies of correct and incorrect responses 
were determined for each item. Initial responses to anticipation items 
were not included. The preliminary ANOVA incorporating key position as a 
variable found a significant interaction between the key position and cor- 
rectness variables (F - 3.15, df - 1, 96). Therefore, one analysis treated 
only key positions 1 and 2 and a second analysis treated only key positions 
3 and 4. These analyses are summarized in Tables 8 and 9. 

Correct and incorrect responses prior to the TLE had essentially the 
same mean latency values. This finding was Independent of key position and 
the effects of the experimental variables of training method and information 
level . 

Since the scores on which these analyses were based were the means of 
all the pre-TLE responses, it was possible that while the pre-TLE averages 
might not differ, the relationship between correct and Incorrect response 
latencies may have changed as a function of practice. For example, correct 
responses might have become faster as an item approached the TLE idille incor- 
rect responses became slower at approximately the same rate. If the correct 
and Incorrect latency curves crossed, this could cause the mean value of the 
curves to be approximately the same. To evaluate this possibility, the la- 
tencies of correct and Incorrect responses were plotted over the pre-TLE 
practice period. The average curve for all treatment groups and key positions 
is Illustrated in Figure 8. It is evident from this plot that the relationship 
between correct and incorrect response latencies did not change systematically 
over trials. Both curves tended to approximate a constant latency of about 
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two soconds. It may ba concludad that prior to tha TLE, corract raaponaa 
latanclas did not dlffar from tha latanclaa of incorract rasponsaa. 

TABLE 8 

Corract and Incorract Raaponaa Latanclaa 
Prior to tha TLE 

Kay Poaitlona 1 and 2 Only 



XraatMnt Group Maana 



Incorract- 



Treatment 




N 


Corract 


Incorract 


Corract 


Information Laval 


1 


22 


1587 


1625 


38 




2 


22 


2051 


2296 


245 


Method 


3 


22 


2156 


2638 


482 


Anticipation 




33 


1852 


1862 


10 


Recall 




33 


2012 


2511 


499 


Total 




66 


1932 


2187 


255 



Analyala of Variance 
(Log trana formation) 



Source 


df 


SS 


MS 


F 


Between Sa Variance 


65 


3,776.12 






Corractnaaa 


1 


22.99 


22.99 


1.90 


I X C 


2 


20.36 


10.18 


<1.00 


M X C 


1 


14.20 


14.20 


1.18 


I X M X C 


2 


24.11 


12.05 


<1.00 


Within Sa Error 


60 


724.13 


12.07 




Total 


131 


4,581.91 







TABLE 9 . 



Correct and Incorrect Reeponee Letenclee 
Prior to the TLE 

Key Poeltlone 3 end 4 Only 



Treetnent Group Meene 

Incorrect 

Treatment N Correc t Incorrec t Correct 



Infometlon Level 





2 


24 


1812 


2134 


322 


Method 


3 


24 


2601 


2167 


-434 


Anticipation 




24 


2127 


1947 


-180 


Recall 




24 


2287 


2354 


67 


Total 




48 


2207 


2151 


-56 





Analysle of Variance 








(Log trane formation) 






Source 


df 


SS 


MS 


P 


Between Se Variance 


47 


2,306.16 






Correctneee 


1 


7.86 


7.86 


<1.00 


1 X C 


1 


28.87 


28.87 


2.30 


M X C 


1 


0.00 


0.00 


<1.00 


I X M X C 


1 


1.88 


1.88 


<1.00 


Within Se Error 


44 


552.61 


12.56 





Total 



95 



2,897.38 
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Fig. 8. Correct and Incorrect 
response latencies prior to the TLE. 
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Rceponse Latency as « Function of Item Difficulty 

On the bMls of Slmley's study, it was expected that for a given 
subject, the more difficult items would have longer latencies than that 
subject's less difficult items. Response latencies prior to and after 
the TLE were investigated separately with respect to this question. 

In general, it was found that those items which were associated 
with the key positions within the key array had longer latencies and also 
required a greater number of trials to reach criterion than did the items 
associated with the end keys 1 and 2. While this relationship was in the 
direction anticipated by the contention that the more difficult items 
would have longer latencies, it is likely that the positive correlation 
was simply an artifact. That is, items which had responses assigned to 
the end keys were probably learned more quickly because of the distinc- 
tive position of the keys and this distinctive position may have also 
made the perceptual motor-task of locating and pressing a key easier 
and hence faster for an end key. Any analysis of the relationship between 
item difficulty and response latency which treated all key positions as 
analogous would be biased by having a greater number of inner key posi- 
tion items in the difficult item group and a majority of items associated 
with keys 1 and 2 in the less difficult item group. Two separate analy- 
ses were therefore conducted which treated key positions 1 and 2 and posi- 
tions 3 and 4 separately. No ANOVA treating key position as a variable 
was conducted. 

Item difficulty was measured by counting the number of trials re- 
quired for an item to reach trial TLE-fl. The most difficult item and the 
least difficult item were selected for each pair of key positions for each 
subject on this basis. Scores were calculated for these items by comput- 
ing the mean latency for all responses (with the exception of initial an- 
ticipation responses) prior to the TLE for the pre-TLE analysis and for 
the first 16 trials after the TLE for the post-TLE analysis. In the case 
of ties for the most or least difficult item, the tied items were averaged 
into a single score. Thus, for each set of analyses, each subject for whom 
data were available was represented by a pair of latency scores for his most 
difficult item and his least difficult item for the key positions relevant 
to that particular analysis. 
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Pre-TLE latency as a function of Item difficulty * Latency data prior 
to the TLE and the number of trials required to reach trial TLE+1 are shown 
in Tables 10 and 11. For some very easy items, no data were available prior 
to the TLE. For the pre-TLE analysis, therefore, the least difficult items 
were selected from that group of Items which had at least one trial after the 
first presentation of the S-R pair and prior to the TLE. 

TABLE 10 

Pre-TLE Response Latencies of 
Most and Least Difficult Items for Each Subject 

Key Positions 1 and 2 Only 



Treatment Group Means 



Treatment N Moat Difficult Least Difficult Most - Least 

Item Item Difficult Item 







Latency Trials 


Latency 


Trials 


Latency 


Trials 


Information Level 

1 


13 


1817 


11.1 


1586 


2.3 


231 


8.8 


2 


13 


1808 


13.3 


2060 


3.6 


-252 


9.7 


3 


13 


2369 


8.8 


2138 


4.4 


231 


4.4 


Total 


39 


1998 


11.1 


1928 


3.4 


70 


7.7 



Analysis of Variance 
(Log transformation) 

Source df SS MS F 

Between Ss Variance 38 1,317.93 



Item Difficulty 1 

I X D 2 

Within Ss Error 36 



17.73 17.73 1.56 
37.66 18.83 1.65 
410.20 11.39 




Total 



77 



1,783.52 
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TABLE II 

Pre-TLE Response Latencies of 
Most and Least Difficult Items for, Each Subject 

Key Positions 3 and 4 Only 



Treatment Group Means 



Treatment 


N 


Most Difficult 
Item 


Least Difficult 
Item 


Most - Least 
Difficult Item 






Latency 


Trials 


Latency 


Trials 


Latency 


Trials 


Information Level 


2 


16 


2046 


10.4 


1516 


3.4 


530 


7.0 


3 


16 


2116 


10.6 


2034 


6.4 


82 


4.2 


Method 


Anticipation 


16 


2150 


12.9 


1716 


5.6 


434 


7.3 


Recall 


16 


2013 


8.1 


1834 


4.2 


179 


3.9 


Total 


32 


2081 


10.5 


1775 


4.9 


306 


5.6 





Analysis of Variance 








(Log transformation) 






Source 


df 


SS 


MS 


F 


Between Ss Variance 


31 


1,139.86 






Item Difficulty 


1 


91.48 


91.48 


13.41 *** 


I x“D 


1 


54.36 


54.36 


7.97 ** 


M X D 


1 


11.92 


11.92 


1.75 


I X M X D 


1 


5.61 


5.61 


<1.00 


Within Ss Error 


28 


190.90 


6.82 




Total 


63 


1,494.13 







** p <.01 

*** p <.001 

Relatively few subjects were available for this analysis. In some 
cases, all of a subject's Items had the same number of pre-TLE trials but 
more often, a subject had an Inadequate amount of pre-TLE data. The amount 
of data available was not sufficient for a complete factorial test including 
all treatment conditions. Only 21 of the 48 recall treatment subjects had 
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pre-TLE data on keys 1 and 2. Since the method factor did not appear to 
alter the relationship between the latencies of the most and least diffi- 
cult Items » anticipation and recall subjects were grouped together. An 
equal ratio of anticipation to recall subjects was maintained In each of 
the three Information levels. As Is shown In Table 10, pre-TLE response 
latency did not differ as a systematic function of Item difficulty for 
key positions 1 and 2. 

There were at least eight subjects available In each experimental 
condition for the Inside key positions 3 and 4 and this was considered to 
be sufficient for a complete factorial analysis. Table 11 Illustrates that 
In this case, the response latencies of the difficult Items were signifi- 
cantly longer than the latencies of the responses to those Items which the 
subjects found to be least difficult. In addition, this difference was 
more pronounced for the four response, two bit task than for the eight re- 
sponse, three bit task. 

Post-TLE latency as a function of Item difficulty . After the TLE, 
data were available for all Items over at least 16 trials. The most and 
least difficult Items for each key position were selected for each subject 
by the procedure described above. A small number of subjects were lost be- 
cause all their Items had the same number of pre-TLE trials. 

Data for key positions 1 and 2 and positions 3 and 4 are presented 
In Tables 12 and 13 respectively. In the case of both analyses, the most 
difficult Items had longer latencies than did the least difficult Items. 

Although the differences were small, on the order of 100 to 200 msec., they 
were significant In both cases. In neither case was there any significant 
Interaction with the Information level or method variables. 

Response Latency as a Function of Subject Learning Rate 

Whereas the previous section Investigated variation In response laten- 
cy as a within subjects function of Item difficulty, the analyses discussed 
In this section examined variation In response latency as a function of In- 
dividual differences In subject learning rate. Responses prior to and after 
the TLE were treated separately. The measure of subject learning rate employed 
was the total number of Item presentations across all Items and all key positions 
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TABLE 12 

Post-TLE Response Latencies of 
Most and Least Difficult Items for Each Subject 

Key Positions 1 and 2 Only 



Treatment 


N 


Treatment Group Means 

Moat Difficult Least Difficult 

Item Item 


Most - Least 
Difficult Item 


Information Level 


26 


Latency 


Trials 


Latency Trials 


Latency 


Trials 


1 


1251 


10.0 


1162 


0.4 


89 


9.6 


2 


26 


1420 


10.0 


1356 


2.3 


64 


7.7 


3 

Method 


26 


1732 


7.7 


1550 


3.3 


182 


4.4 


Anticipation 


39 


1611 


13.1 


1455 


3.5 


156 


9.6 


Recall 


39 


1325 


5.4 


1258 


0.5 


67 


4.9 


Total 


78 


1464 


9.2 


1356 


2.0 


108 


7.2 





Analysis of Variance 








(Log transformation) 






Source 


df 


SS 


MS 


F 


Between Ss Variance 


77 


1,792.46 






Item Difficulty 


1 


25.89 


25.89 


5.03 * 


I X D 


2 


6.77 


3.38 


<1.00 


M X D 


1 


6.91 


6.91 


1.34 


I X M X D 


2 


4.98 


2.49 


<1.00 


Within Ss Error 


72 


370.92 


5.15 




Total 


155 


2,207.93 






* p <.05 











prior to iJid Including the TLE. From each treatment group of 16 subjects, 
the four subjects who had the highest such scores were classified as slow 
learners. The four subjects who had the lowest scores In each treatment 
group were classified as fast learners. In the pre-TLE analysis, three of 
the fast learners had no data prior to the TLE and had to be replaced with 
subjects who were slightly slower learners. 
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TABLE 13 

Post-TLE Response Latencies of 
Most and Least Difficult Items for Each Subject 

Key Positions 3 and A Only 



Treatment Group Means 

Treatment N Most Difficult Least Difficult Most - Least 



Item Item Difficult Item 



Information Level 




Latency 


Trials 


Latency 


Trials 


Latency 


Trials 


2 


28 


1A29 


10.8 


1266 


2.4 


163 


8. A 


3 

Method 


28 


1963 


10.9 


1817 


6.1 


1A6 


A. 8 


Anticipation 


28 


1890 


13.8 


1656 


5.7 


23A 


8.1 


Recall 


28 


1502 


7.9 


1A28 


2.8 


7A 


5.1 


Total 


56 


1696 


10.8 


15A2 


A. 3 


15A 


6.5 



Analysis of Variance 
(Log Transformation) 



Source 


df 


SS 


MS 


F 


Between Ss Variance 


55 


1,669.99 






Item Difficulty 


1 


37.51 


37.51 


6.59 * 


I X D 


1 


1.7A 


1.7A 


< 1.00 


M X D 


1 


12.72 


12.72 


2.2A 


I X M X D 


1 


1.17 


1.17 


< 1.00 


Within Ss Error 


52 


296.06 


5.69 




Total 


111 


2,019.19 






* p < . 05 










Pre-TLE latency as 


a function of subiect 


learning rate. 


A single pre- 


TLE response latency score was calculated for each key position for each sub- 


ject. This score was the 


mean of 


all response latencies after 


the first pre- 


sent at ion of the S-R pair and prior to the TLE. 


It was found 


that key position 


was not a relevant variable (F < 1.0) and a single analysis including all key 


positions was conducted. 


The results of this analysis are presented in Table 


lA together with the mean 


response latencies and 


the mean number of pre-TLE 


trials per item for e.>ch 


treatment 


: group. 
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TABLE 14 

Pr®*“TLE Response Latencies of 
Slowest and Fastest Learners 

All Key Positions 



TreatiHient Group Means 



Treatment 


Slow Learners 


Fast Learners 


Slow-Fast 


Learners 


Information Level 


Latency 


Trials 


Latency 


TrlAls 


Latency 


Trials 


1 


1500 


7.1 


1525 


1.1 


-25 


6.0 


2 


1878 


11.4 


1527 


2.3 


351 


9.1 


3 

Method 


2318 


11.7 


2604 


4.1 


-286 


7.6 


Anticipation 


1866 


12.9 


2000 


3.5 


-134 


9.4 


Recall 


1932 


7.3 


1771 


1.5 


161 


5.8 


Total 


1899 


10.1 


1885 


2.5 


14 


7.6 





Analysis of Variance 








(Reciprocal transformation) 






Source 


df 


SS 


MS 


F 


Variance due to 










Information and 


5 


5,335.05 






Method Variables 










Subject Learning ^te 1 


275.82 


275.82 


< 1.00 


I X R 


2 


64.25 


32.12 


< 1.00 


M X R 


1 


1.68 


1.68 


< 1.00 


I X M X R 


2 


363.95 


181.97 


< 1.00 


Error 


36 


13,376.71 


371.58 




Total 


47 


19,417.46 







The slow and fast learners differed only slightly In their pre-TLE 
response latencies. Neither the learning rate variable nor any interaction 
between learning rate and the infomatlon level or method variables was 
significant. It may be concluded that slow and fast learners did not differ 
in response latency prior to the TLE. 
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Post"'TLE latency as a function of subject learning rate . A single 
post-TLE response latency score was calculated for each key position for 
each subject. This score was the mean of the first 16 post-TLE responses. 
The preliminary key position .\NOVA Inidlcated a significant Interaction be- 
tween key position and the learning rate variable (F ■ 3.37, df *■ 1, 2A) . 
Therefore, two separate analyses for key positions 1 and 2 and positions 3 
and A were conducted. The results of these analyses are summarized in 
Tables 15 and 16 together with the mean response latencies and the mean 
number of pre-TLE trials per Item for each treatment group. 

TABLE 15 

Post-TLE Response Latencies of 
Slowest and Fastest Learners 

Key Positions 1 and 2 Only 
Treatment Group Means 



Treatment Slow Learners Fast Learners Slow- Fast Learners 





Latency 


Trials 


Latency 


Trials 


Latency 


Trials 


Information Level 


1 


1245 


7.1 


1049 


1.0 


196 


6.1 


2 


1547 


11.4 


1227 


2.0 


320 


9.4 


3 


1732 


11.7 


1867 


3.8 


-135 


7.9 


Method 


Anticipation 


1673 


12.9 


1486 


3.5 


187 


9.4 


Recall 


1344 


7.3 


1276 


1.0 


68 


6.3 


Total 


1508 


10.1 


1381 


2.3 


127 


7.8 



Analysis of Variance 
(Reciprocal transformation) 



Source 


df 


SS 


MS 




F 


Variance due to 












Information and 


5 


101,635.26 








Method Variables 












Subject Learning Rate 


1 


31,243.48 


31,243.48 




6.79 * 


I X R 


2 


3,545.46 


1,772.73 


< 


1.00 


M X R 


1 


526.15 


526.15 


< 


1.00 


I X M X R 


2 


785.40 


392.70 


< 


1.00 


Error 


36 


165,703.26 


4,602.87 






Total 


47 


303,439.01 









* p< .05 



o 



56 



TABLE 16 

Post-TLE Response Latencies of 
Slowest and Fastest Learners 

Key Positions 3 and 4 Only 



Treatnent Group Means 



Treatment 


Slow Learners 


Fast Learners 


Slow-Fast 


Learners 




Latency 


Trials 


Latency 


Trials 


Latency 


Trials 


Information Level . . 


2 


1521 


11.4 


1264 


2.0 


257 


9.<» 


3 


1971 


11.7 


1883 


3.8 


88 


7.9 


Method _ _ 


Anticipation 


49^4 


14.3 


1805 


4.4 


129 


9.9 


Recall 


1558 


8.8 


1342 


1.4 


216 


7.4 


Total 


1746 


11.6 


1574 


2.9 


172 


8.7 



Analysis of Variance 
(Reciprocal transformation) 



Source 


df 


SS 


MS 


F 


Variance due to 










Information and 


3 


85,634.94 






Method Variables 










Subject Learning Rate 


1 


4,852.48 


4,852.48 


1.20 


I X R 


1 


4,754.56 


4,754.56 


1. 18 


M X R 


1 


847.34 


847.34 


< 1.00 


I X M X R 


1 


1,884.06 


1,884.06 


< 1.00 


Error 


24 


96,821.52 


4,034.23 




Total 


31 


194,794.90 







The treatment group latency means in these tables Indicate that for 
both sets of key positions, slow learners had slightly longer response 
latencies during the post-TLE trials. This difference was, however, sig- 
nificant for only the outer key positions, keys 1 and 2. There were no 
significant interactions between the variables of subject learning rate and 
Information level or method in either analysis. 
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Response Latency In the Area of t:he TLE 

Response latency in the area of the TLE itself is of special interest. 
Suppes , Groen and Schlag-Rey (1966) found response latencies on the TLE to 
be consistently longer than the latencies of the immediately preceding and 
following trials. In addition, preceding sections have shown that while 
latencies prior to the TLE remained constant and independent of practice, 
post— TLE latencies decreased rapidly as a function of practice. The TLE 
thus appears to be a point of some importance in the systematic changes in 
latency over learning. It was reasoned that the Investigations of greatest 
Interest would compare the TLE latency to the latencies of the immediately 
preceding and subsequent trials. As will be discussed below, these two com- 
parisons involved different criteria for including data in the analysis. 
Separate analyses were, therefore, conducted to contrast TLE latency with 
response latencies on trials TLE-1 and TLE+1. 

Changes in latency from trial TLE-1 to the TLE . Only those items were 
considered which had an incorrect response on trial TLE-1 which was not an 
initial anticipation response. All such items which were available were av- 
eraged together to yield two mean scores for each subject, one representing 
the latency of an error response on trial TLE— 1 and the other representing 
the TLE latency. These scores were treated as a within subjects variable 
in a factorial ANOVA in which information level and method were between sub- 
jects variables. Key position had no effect on the trials variable (F * 1.27, 
df * 1, 60) and therefore, a single analysis treating all key positions was 
conducted. The results of this analysis are summarized in Table 17. 

The increase in incorrect response latency from trial TLE-1 to the 
TLE, averaged over all experimental conditions was only 102 msec. This dif- 
ference was not significant nor were there any significant interactions with 
the experimental variables . It may be concluded that the latency of the TLE 
response was not substantially greater than the latency of immediately pre- 
ceding Incorrect responses. 

Changes In latency from the TLE to trial TLE-H . This analysis investi- 
gated the question of whether or not there was a significant drop in latency 
from the TLE to the first trial past the TLE. All item protocols were con- 
sidered which had a TLE trial which was not an initial anticipation response. 
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TABLE 17 

Comparison of Incorrect Response Latencies 
on Trials TLE-1 and TLE 

All Key Positions 



Treatment Group Means 



Treatment 


N 


Trial TLE-1 


Trial TLE 


TLE - TLE-1 


Information Level 

1 


16 


1605 


1770 


165 


2 


16 


2323 


2525 


202 


3 


16 


2516 


2455 


-61 


Method 

Anticipation 


24 


2163 


2214 


51 


Recall 


24 


2134 


2287 


153 


Total 


48 


2148 


2250 


102 





Analysis of Variance 








(Reciprocal transformation) 






Source 


df 


SS 


MS 


P 


Between Ss Variance 


59 


62,522.42 






TEL-1 vs. TLE 


1 


131.92 


131.92 


< 1.00 


I X T 


2 


460.38 


230.19 


1.21 


M X T 


1 


42.49 


42.49 


< 1.00 


I X M X T 


2 


219.80 


109.90 


< 1.00 


Within Ss Error 


54 


10,232.28 


189.49 




Total 


119 


73,609.29 







A pair of scores representing trials TLE and TLE+1 were computed for each 
subject who had at least one available protocol by taking the mean of all 
available response pairs. These scores were treated as a within subjects 
variable In a factorial ANOVA In which information level and method were be< 
tween subjects variables. The key position variable was found to have no 
significant interaction with the trials variable (F < 1.0) and therefore, a 
single ANOVA treating all key positions was conducted. The results of this 
analysis are summarized in Table 18. 
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TABLE 18 



Comp &r Ison of Response Latencies 
on Trials TLE and TLE+1 

All Key Positions 



Treatment Group Means 



Treatment N Trial TLE Trial TLE+1 TL E . - TL Ej-j 



Information 




Level 


Method 




1 


Anticipation 


15 


1 


Recall 


15 


2 


Anticipation 


15 


2 


Recall 


15 


3 


Anticipation 


15 


3 


Recall 


15 


1 


• 


30 


2 


• 


30 


3 


• 


30 


• 


Anticipation 


45 


• 


Recall 


45 


Total 




90 



1914 


1652 


262 


1547 


1470 


77 


1890 


1608 


282 


2508 


1580 


925 


2877 


2826 


51 


2224 


2321 


-97 


1730 


1561 


169 


2199 


1594 


605 


2550 


2573 


-23 


2227 


2029 


198 


2093 


1790 


303 


2160 


1909 


251 



Analysis of Variance 
(Reciprocal transformation) 



Source 

Between Ss Variance 

TLE vs. TLE+1 
I X T 
M X T 
I X M X T 
Within Ss Error 

Total 
* p <,05 

** p <.01 

*** p < , 001 



df 


SS 


89 


67,692.50 


1 


2,233.10 


2 


1,460.65 


1 


3.37 


2 


1,752.61 


84 


14,016.07 


179 


87,158.30 



MS 


F 




2,233.10 


13.38 




730.32 


4.38 


* 


3.37 


< 1.00 




876.30 


5.25 




166.86 
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Responses on trial TLE+1 were, on the average, 251 msec, faster than 
responses on the TLE. This was a significant reduction. The magnitude of 
the reduction in latency was a complex function of the information levels 
with the middle, two bit task demonstrating the greatest change. There was, 
in addition, a significant three way interaction between Information level, 
method and TLE relative trial number. This may be attributed to the finding 
that while the decline was greater for the anticipation than for the recall 
treatments on the one and three bit tasks, the two bit, recall treatment 
group demonstrated a reduction in latency of 925 msec, that was much greater 
than that of the comparable anticipation group. Examination of the scores 
of the individual subjects in two bit, recall condition indicated that this 
was a consistent trend. Of the 15 subjects, 13 demonstrated a reduction in 
latency from the TLE to the next trial and of these 13, five had a reduction 
in latency that was greater than one second. 

It may be concluded that while, in general, responses were faster on 
trial TLE-fl than on the TLE, this effect was negligible for the eight 
response, three bit task. Furthermore, the particular combination of con- 
ditions present in the two bit, recall task resulted in an unusually large 
decrement in response latency. 

Latency trends in the area of the TLE . Following the completion of 
the previous two analyses it was felt that a more adequate description of 
changes in latency in the area of the TLE was needed. All item protocols 
which had at least three pre-TLE trials (disregarding initial anticipation 
responses) were selected. Approximately 50 per cent of the items met this 
criterion. Mean correct and Incorrect response latencies for trials TLE-3 
through TLE+3 were calculated for each subject who had at least one item 
protocol which met the criterion. All key positions were Included and treated 
as equivalent. The scores of all the available subjects were then averaged 
together to obtain treatment group means. The resulting data together with 
the number of subjects available in each treatment group are presented in 
Table 19. 
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TABLE 19 

Correct and Incorrect Response Latencies 
in the Area of the TLE 



All Key Positions 



Treatment 



Inf or. 

Level Method 
1 Antcp. 



N 



Correct- 
Incorrect TLE-3 



TLE Relative Trial Number 
TLE-2 TLE-1 TLETLE+1 TLE-f2 TLE^-3 



14 



C 

I 



1813 

1806 



1 


Recall 


14 


C 


1542 








I 


1723 


2 


Antcp. 


16 


C 


1683 








I 


1521 


2 


Recall 


13 


C 


2685 








I 


1843 


3 


Antcp. 


16 


C 


2672 








I 


2893 


3 


Recall 


15 


C 


2435 








I 


2193 


1 


• 


28 


C 


1689 








I 


1769 


2 


• 


29 


C 


2107 








I 


1642 


3 


• 


31 


C 


2561 








I 


2579 


• 


Antcp. 


46 


C 


2081 








I 


2126 


• 


Recall 


42 


C 


2239 








I 


1963 


Total 




88 


C 


2152 








I 


2057 



2269 

1334 


1655 

2092 


1990 


1439 


1569 


1414 


1309 

1955 


1616 

1625 


1621 


1565 


1405 


1260 


1941 

2127 


1511 

2013 


1907 


1660 


1883 


1521 


2047 

2736 


2297 

3172 


2425 


1755 


1590 


1359 


2923 

2379 


2641 

2642 


2897 


2692 


2337 


2117 


2249 

2031 


1882 

2485 


2120 


1916 


1839 


1721 


1852 

1595 


1636 

1920 


1805 


1502 


1487 


1337 


1987 

2371 


1848 

2510 


2144 


1703 


1752 


1448 


2608 

2224 


2287 

2567 


2521 


2317 


2096 


1925 


2417 

2006 


1954 

2260 


2277 


1952 


1945 


1696 


1913 

2246 


1929 

2491 


2051 


1749 


1617 


1455 


2191 

2108 


1943 

2359 


2169 


1855 


1789 


1581 


were 


made on 


these 


data. 


there do 


appear 



Although no statistical tests 
to be several trends which may be promising for future investigation. First , 
it will be noted that for this particular selection of data, the latency of 



the TLE response was, in general, shorter than the latency of an immediately 
preceding incorrect response. This trend held for five of the six treatment 
groups but was more pronounced for the recall training method conditions. 
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The most accurate descriptive statement that can be made based on this data 
is tbit incorrect response latencies tended to reach a peak during the last 
few trials prior to and including the TLE. There did not appear to be any 
reliable sharp division points. 

Secondly, it will be recalled that it was previously demonstrated that, 
in general, the latency of correct and Incorrect responses prior to the TLE 
did not differ. For the sample of data shown in Table 19, there were no 
systematic differences between correct and Incorrect response latencies on 
trials TLE-3 and TLE-2 but on trial TLE-1, correct response latencies were 
consistently shorter than the latencies of the corresponding Incorrect re- 
sponses. While the two bit, recall and three bit, anticipation tasks had 
only negligible differences between correct and Incorrect response latencies, 
the other four task conditions demonstrated substantial differences. It 
may be the case that response latencies do become indicative of the correct- 
ness of the response as the item approaches the point at which it is finally 
learned. 

Finally, the data sample represented in Table 19 suggests that the 
decline in correct response latency evident after the TLE may begin prior 
to the TLE. Under each of the three anticipation training method condi- 
tions, mean correct response latency declined from trial TLE-2 to trial 
TLE-1. Under the recall paradigm, only the three bit task demonstrated a 
reduction in latency across these trials but for all three information 
levels , latency on trial TLE-2 was less than the latency of the preceding 
trial. 

Since these trends were postulated a posteriori with reference to a 
particular sample of data, the use of statistical tests to evaluate the 
frequency of their occurrence would not appear to be justified. They are 
presented only as an attempt to clarify for future study the nature of la- 
tency behavior during an important phase of the learning process. 

First Correct Response Latency as a Function of Subsequent Errors 

The final analysis reversed past procedure by examining latency on the 
trial of the first correct response rather than on trials relative to the TLE. 
The latency of the first correct response was determined for each item for each 
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subject. For subjects run under the anticipation procedure, the latency 
score used was that of the first correct response following the initial 
response to that item. All such first correct responses were then divided 
into two groups on the basis of whether or not the subject made any errors 
after the first correct response and prior to reaching the criterion of 
six successive errorless trials. To remain consistent with the terminology 
suggested by Williams (1962) , those items on which subsequent errors did 
occur were termed break items. Items for which there was no subsequent 
error were termed nonbreak Items. For each subject, a pair of scores was 
computed which consisted of the mean latencies of the first correct responses 
of all the break and nonbreak items for that subject. These scores were 
treated as a within subjects variable in a factorial ANOVA in which informa- 
tion level and training method were between subjects variables. Subjects 
whose data did not Include both break and nonbreak items were excluded from 
consideration. At least 12 subjects were available in each treatment group. 
The key position variable did not interact with the break versus nonbreak 
item variable (F - 1.66, df - 1, 56) and therefore, all key positions were 
Included in a single analysis. A summary of the data and the results of 
this analysis are presente in Table 20. 

correct responses to break items had longer latencies than the 
corresponding nonbreak items for five of the six treatment groups. This 
difference was significant. The magnitude of the difference increased as 
a positive function of information level for the anticipation procedure 
groups but was a nonlinear, U-shaped function of information level for the 
recall procedure groups. The significant three-way interaction shown in 
Table 20 is the result of these varying relationships. 

To relate the findings of this analysis to the previously discussed 
analyses taking their point of origin from the TLE, it may be pointed out 
that the first correct responses of break items occurred prior to the TLE 
while the first correct responses of nonbreak items occurred on trial TLE+1. 
The results of this analysis are therefore consistent with the previous 
findings that correct responses remain relatively slow on the trials prior 
to the TLE and are then considerably faster on trial TLE+1. In addition, 
however, this analysis does suggest that when a nonbreak item was learned. 
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TABLE 20 

Latencies of First Correct Responses 
Divided on the Basis of the 
occurrence of Subsequent Errors 

All Key Positions 



Treatment Group Means 



Treatment 


N 


Break Items 


Nonbreak Items 


Break-Nonbreak 


Informutlon Method 

Level 

1 Anticipation 


12 


1746 


1647 


99 


1 


Recall 


12 


1544 


1248 


296 


2 


Anticipation 


12 


1436 


1285 


151 


2 


Recall 


12 


2707 


1589 


1118 


3 


Anticipation 


12 


2774 


2367 


407 


3 


Recall 


12 


1846 


2119 


-273 


1 


s 


24 


1645 


1447 


198 


2 


s 


24 


2071 


1437 


634 


3 


s 


24 


2310 


2243 


67 


s 


Anticipation 


36 


1985 


1766 


219 


s 


Recall 


36 


2032 


1652 


380 


Total 




72 


2009 


1709 


300 



Analysis of Variance 
(Reciprocal transformation) 



Source 


df 


SS 


MS 


F 


Between Ss Variance 


71 


61,918.75 






Break vs. Nonbreak 


1 


3,433.14 


3,433.14 


19.44 ** 


1 X B 


2 


25.02 


12.51 




M X B 


1 


1.30 


1.30 




1 X M X B 


2 


1,161.07 


580.53 


3.29 * 


Within Ss Error 


66 


11,653.78 


176.57 






Total 
* p < .05 

** p < .001 



143 



78,193.06 
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as Indicated by the fact that no more errors were made on that Item, the 
latency of the response was Immediately shortened. Although all the pre- 
ceding responses had been In error, the subject's very first production of 
the correct response was substantially faster than the preceding responses. 



66 



Cone lua Ions and Dlacusilon 

Training Method 

It was expected that the recall paradigm would result In shorter and 
leas variable latencies prior to the TLE than would the anticipation method. 
In previous work, Peterson (1963) was unable to identify any consistent 
trends prior to the TLE. He suggested that the absence of apparent trends 
was due to the high variability of latency measures and further suggested 
that the variability early in learning might be due to interference effects 
resulting from the confounding of training and testing procedures under the 
anticipation paradigm. The present investigation found, however, that pre- 
TLE response latencies did not differ between the two paradigms in either 
duration or variability. 

The recall paradigm did result in faster learning and a lower post- 
criterion error rate — a finding which is in agreement with previous research 
(Battlg and Brackett, 1961; Battlg and Wu, 1965). The recall paradigm did, 
therefore, have some instructional advantage and this finding in itself 
might lead one to expect that pre-TLE latencies would be shorter under the 
recall paradigm. If the recall training method was more efficient because 
interference effects were reduced under this paradigm, the response latency 
measures must have not been sensitive to the interference effects. 

After the TLE, the recall paradigm resulted in shorter and less var- 
iable latencies than did the anticipation paradigm. The reduced variability 
was probably not meaningful in itself. Averaged over all post-TLE latencies, 
the ratio of the standard deviation to the mean was 0.40 for both the antici- 
pation and recall paradigms. The smaller magnitude of the recall method 
latencies could have been the result of one or both of two separate factors. 
First, responses may have been effectively paced at a higher rate in the 
recall paradlgri than in the anticipation paradigm. The minimum possible 
elapsed time between recall responses was 1.5 seconds. Due to the knowledge 
of results presentation, the minimum time between anticipation responses was 
3.5 seconds. The different rates at which the items were presented may be 
analogous to the situation discussed by Williams (1962). Williams' subjects 
learned word pairs by the anticipation method. Knowledge of results was 
exposed for either one or four seconds. The longer exposure time resulted 
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In a significant reduction In the number of trials required to reach criter- 
ion but did not produce the expected reduction In latencies. Williams sug- 
gested that the slower presentation rate resulting from the longer knowledge 
of results exposure may have specifically Increased latencies. The anticipa- 
tion paradigm latencies may have been increased for the same reason In the 
post-TLE period of the current experiment but If this was the case, it might 
be expected that the effect would have also been present In the data prior 
to the TLE. 

If, on the other hand, response latencies after the TLE are Indicative 
of the degree of overlearning and If the recall paradigm Is a more efficient 
training method during overlearning as well as during early learning, the 
shorter post-TLE latencies may reflect the higher response strengths of the 
Items learned under the recall paradigm. It will be recalled that the differ- 
ence between the post-TLE recall and anticipation latencies Increased as a 
function of practice. This would be expected if the anticipation-recall dif- 
ference was due to suprathreshold response strength increasing at a faster rate 
under the recall paradigm. However, the same effect might be expected If the 
difference were due to a discrepancy In the rate at which the two tasks ware 
paced. A comparison of the two methods In which Interresponse int:::rval was 
held constant across the two paradigms should differentiate between hypotheses. 

In summary, the recall paradigm was the more efficient training pro- 
cedure In terms of response probability. Response latency prior to the TLE 
was independent of the training method. As practice was continued after the 
TLE, recall treatment latencies became Increasingly shorter than the corres- 
ponding anticipation response latencies. If post-TLE latencies are Indeed 
indicative of suprathreshold response strength, recall may also be the more 
efficient training procedure during overlearning. 

Information Transmission Requl rements 

As wa&' anticipated from the reaction time literature, response latency 
Increased as the number of response alternatives Increased. These results 
support the findings of Brlcker (1955) and Rabbltt (1959) that variation In 
the number of response alternatives rather than the number of stimuli is 
sufficient to alter the Information characteristics of the task. In the cur- 
rent experiment, all three Information level groups had eight Item stimulus 
lists. Only the number of response alternatives differed. 
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Th« latencies of the different information level groups became 
ordered on the basis of the number of response alternatives very soon 
after the start of the main task. Pre~TL£ response latencies, averaged 
across training methods, closely approximated a linear function of the 
amount of potential information in the task, that is, a log^ function of 
the number of response alternatives. Since the subjects were making 
errors during this period, however, the amount of information actually 
being transmitted was much smaller. The average amount of information 
transmitted per response in the two, four and eight response alternative 
tasks was approximately 0.01, 0.13, and 0.36 bits respectively. It 
would be expected from the reaction time literature that response laten~ 
cles would be a linear function of the amount of information actually 
being transmitted but the latency data appeared to be more a linear 
function of the amount of potential information in the task. 

On the TLE itself, latency was approximately a linear function 
of the potential information in each task. There was a slight tendency 
toward concavity but this should probably be discounted in view of the 
subsequent results . 

Following the TLE, the amount of transmitted information approxl** 
mated the potential information in each task. Immediately after the TLE, 
the function became positively accelerated in that the eight response 
task had excessively long latencies. As post-TLE practice continued, 
however, the function became more linear. This was true for both the 
outside key positions (keys 1 and 2 alone) and for all key positions 
taken together. Response latencies on the eight key task decreased more 
quickly for the outside keys and for these keys, the function was essen- 
tially linear for the post-TLE trials 8 through 16. There is no reason 
to expect that the function would not have become linear for all keys if 
practice had been continued for several more trials. 

Several summarizing conclusions may be drawn. Response latency in- 
creased as the number of response alternatives was Increased. The subject* 
latency behavior reflected the different nunbers of response alternatives 
very soon after the beginning of the task. During the early stages of 
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learning, prior to and including the TLE, latency was a linear function of 
the potential information in the task. Immediately following the TLE, when 
the transmitted information approximated the potential information, latency 
became a positively accelerated function of the amount of information in the 
task but as practice continued, the function became more linear. 



Response Latency Prior to the TLE 

A subject’s first response to an item was slightly faster under the 
anticipation paradigm than under the recall paradigm. This probably reflected 
the fact that the anticipation subjects were simply guessing on the first 
trial while the recall subjects, having once viewed the correct pairs, had 
some basis for making a decision. 

There was a tendency for the latency of difficult items to increase 
over practice prior to the TLE. This increase was more pronounced under the 
anticipation paradigm and for the eight response tasks but the trend was not 
significant for any of the treatment groups. There was definitely no evi- 
dence of a reduction in latency as a function of pre-TLE practice until the 
last one or two trials prior to the TLE. During the period in which correct 
response probability Increased from 30 to 5A per cent, response latencies 
remained essentially constant. It would appear that latency was not indic- 
ative of response strength during the pre— TLE period. 



Coffect response probability averaged across all treatment groups 
would be expected to be 0.25 by chance alone. The obtained probability, 
averaged over the entire pre-TLE period, was 0.A5. Therefore, roughly half 
of the correct responses observed during this period could have been due to 
factoiE!'S other than chance. If these factors had any effects on the latency 
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correct responses were 482 msec* fester than Incorrect responses* For 
items assigned to inside keys, correct responses were 434 msec, slower 
than Incorrect responses. A portion of this discrepancy may be attributed 
to differences in average response speed between the keys. It will be 
recalled that, in general, responses to outside keys were faster than 
responses to inside keys. For items assigned to outside keys, all the 
correct responses would be to the faster, outside keys but some portion 
of the Incorrect responses would be to the slower, inside keys. The sit 
nation would be reversed for the items assigned to the inside keys. When 
allowance Is made for this influence, there would not appear to be any 
strong systematic difference between correct and incorrect responses in 
even the eight response tasks. It seems most parsimonious to conclude 
that the influence of the learning factors evident in correct response 
probability prior to the TLE could not be detected on the basis of the 
latencies of correct and incorrect responses. 

Xhe latency data were quite variable during this period and the 
hypothesized stabilizing effects of the recall paradigm training method 
did not occur. It may be the case that the variability in response 
latency is inherent in the response production process in the early 
stages of learning and is not attributable to the postulated interfer- 
ence effects of the anticipation paradigm. 

One of the few factors which did have a significant influence on 
latency during the pre-TLE period was the number of response alternatives. 
As was discussed in the previous section, latencies were proportional to 
the amount of information which could be transmitted in each task 

gygQ though much less information was actually being transmitted. 

Ihe effects of variation In Item difficulty are rather difficult 
to assess during the pre-TLE period. On the outside keys, there was a 
considerable range of difficulty as measured by the number of trials re- 
quired to reach the TLE but the corresponding difference in latency was 
negligible. There was a comparable range of difficulty for the inside 
keys and in that case, the corresponding difference in latency was highly 
significant with the most difficult items being 306 msec, slower than the 
easiest items. There was also a significant interaction with information 
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level for these keys and the item latency by difficulty relationship was 
almost solely due to the data from the four response tasks. There is no 
obvious reason why this particular situation should have resulted in a 
significant relationship. The latency differences between hard and easy 
items, ambiguous as they were, do suggest that thei*e was some increase in 
latency if an item continued over a considerable number of trials without 
being learned. It may be that the subjects were able to recognize the 
stimulus component as being a member of a difficult item before they were 
able to supply the correct response member. 

If subjects did recognize difficult items and responded more slowly 
to these items, it might be expected that all or most of a subject 'e 
average pre-TLE response latency would be relatively slow as compared to 
the average latency of a fast learner. This was not found to be the case. 
There was a fairly broad range of individual differences in subject learn- 
ing rate as defined by the average number of pre-TLE trials per item but 
pre-TLE latency was independent of subject learning rate. If pre-TLE 
latencies do vary as a function of item difficulty, it is apparently a 
matter of the relative difficulty for that particular subject. 

Response Latency In the Area of the TLE 

The TLE is by definition a meaningful transition point in the learn- 
ing process as it is measured by response probability. It was therefore 
anticipated that the TLE would be a point at which sharp, systematic changes 
in latency measurements would also occur. This anticipation was supported 
by the finding in the current experiment, as well as in previous studies, 
that response latencies remained fairly constant prior to the TLE and then 
began to decrease immediately following the TLE. The importance of the 
TLE was further implied by the finding of Suppes. Groen and Schlag-Rey (1966) 
that latency on the TLE was greater than the latencies of the immediately 
preceding or subsequent responses a higher proportion of the time than would 
be expected on the basis of chance alone. The results of the current exper- 
iment suggest that the change in latency associated with the TLE may not be 
as discrete as was suggested by the Suppes et al . study. 

It was found that latency on the TLE was not significantly greater 
than the latency of the immediately preceding incorrect responses. For 
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Items which had a number of trials prior to the TLE, there did appear to 
be some increase in Incorrect response latency as items approached the TLE 
but the maximum latency tended to occur one or two trials prior to the TLE 
as often as it occurred on the TLE itself* This was true for the two and 
four response anticipation tasks, the tasks which were most similar to the 
conditions employed by Suppes, Groen and Schlag-Rey, and it is not apparent 
why the results differed between the two experiments. 

There was a large and significant drop in latency from the TLE to 
trial TLE+1. The reduction was greatest for the four response task and 
within this task, the decline was more pronounced for the recall training 
condition. The recall condition demonstrated only negligible differences 
between the two trials on the two and eight response tasks and it is not 
evident what factors were responsible for these significant interactions. 

Since response latencies were, in general, constant prior to the 
TLE, the significant reduction in latency immediately following the TLE 
suggests that the post-TLE decline began on trial TLE+1. For some items, 
the decline did not begin until a few trials after the TLE but since cor- 
rect responses could have occurred by chance alone after the TLE, correct 
response probability may not have reached asymptote for these items until 
one or two trials after the TLE. If latencies did begin to drop only after 
correct response probability reached asymptote, the implication is that 
probability and latency are both measures of the same process but latency 
only becomes a sensitive measure when the probability measure has reached 
asymptote. Closer examination of the data, however, suggests a lower cor- 
relation between correct response probability and response latency. By 
definition, correct response probability did not reach asymptote until 
after the TLE but the decline in latency appeared to begin prior to the 
TLE for some items. Although the conclusions are speculative, it appeared 
to be the case that in some Instances, correct response latencies became 
shorter while Incorrect response latencies remained constant or Increased 
slightly on the last one or two trials prior to the TLE. No such trends 
are evident in the data available from previous studies but if the tenden- 
cies detected in this experiment are indicative of the underlying processes^ 
latency may become a sensitive measure before the point at which correct 
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response probability reaches asymptote* It might further be inferred that 

response probability and latency are measuring two different factors* 

Rather than viewing the TLE as a point at which distinct changes occur 

in both correct response probability and response latency, it may be more 
fruitful to consider the trials immediately prior to and after the TLE as an 
area of transition* The area may be analogous to a psychophysical threshold 
in that while distinctly different situations hold on either side of the thresh 
old, the behavior in question is highly variable and probabilistic in the area 
of the threshold itself* The most accurate statement that can be made at this 
time is that the probability of a correct response reaches asymptote on or 
soon aftur the TLE and latencies begin to decline one or two trials before or 
after the TLE* 

Response Latency During Overlearning 

Response latency after the TLE was a negatively accelerated. Inverse 
function of practice* The decrement curves could have been the result of 
an increasingly large proportion of Items undergoing a sudden, discrete re~ 
ductlon in latency but examination of the response curves of individual 
items indicated that the observed decline resulted from a gradual decrement 
in latency for all items* The major portion of the decline occurred on the 
first few trials after the TLE but there was no indication that the curve 
had reached asymptote at the point at which practice was terminated* It is 
difficult to predict at what point the latencies would have reached as 3 nnptote. 
None of the previous studies continued practice beyond ten trials past the 
TLE* 

Both the information level and method variables had significant effects 
during overlearning* Latencies were a positive function of the amount of in- 
formation transmitted per response and the recall procedure resulted in a more 
rapid decline in latency than did the anticipation procedure* 

Post-TLE Interltem variability was considerably smaller than pre-TLE 
variability* The mean standard deviation, over all treatment conditions, was 
approximately half as large after the TLE as it was prior to the TLE. Part 
of this reduction may be attributed to shorter post-TLE latencies but the 
ratio of the standard deviation to the mean was 0*53 prior to the TLE and 0*40 




after the TLE* 



It was found that post-TLE response latencies were a significant, 
positive function of item difficulty as defined by the number of trials 
required to reach the TLE. While the data obtained by Mlllward (1964) 
and Suppes, Groen and Schlag-Rey (1966) Indicate that longer pre-TLE re- 
sponse protocols and slower post-TLE responses, It was not possible to 
determine from the available data whether this effect was due to Item 
difficulty or individual differences in learning rate. Slmley (1933) 
had demonstrated a similar effect within the data of individual subjects 
but the data were derived from only a portion of the responses of only 
three subjects and were obtained under a prompting paradigm. Pr .-TLE 
latency differences between the most and least difficult items were not 
large but it must be remembered that these differences were derived from 
mean latency scores averaged over the first 16 post-TLE trials; it may 
be the case that the differences were more pronounced immediately after 
the TLE. The interesting aspect of this relationship is that during 
the post-TLE period, the response strengths of the most and least diffi- 
cult items would have been defined as equivalent on the basis of correct 
response probability and the number of trials of overlearning which each 
item had received. An obvious area for future research would be to at- 
tempt to determine if some indicant of response strength such as reten- 
tion or transfer would confirm the latency measure suggestion that the 
response strengths of the two types of items still differed. 

It is possible that post-TLE differences in response latency between 
the most and least difficult items were not an indicant of response strength 
but simply due to the items being practiced with different response speeds 
during the pre-TLE period. Shlffrin and Logan (1965) demonstrated that 
paired associate response latencies were longer if previous practice was 
controlled at a slower response rate. The current study did find that dif- 
ficult items had longer latencies prior to the TLE and the practice effect 
alone could account for the post-TLE difference. 

In addition to intrasubject differences in latency as the result of 
item difficulty, post-TLE latencies were demonstrated to be related to sub- 
jer>t learning rate. Slow learners tended to be slow responders during the 
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post-TLE period. The difference between fast and slow learners was signifi- 
cant on only the outside positions, keys 1 and 2. The mean scores on the 
Inside keys, although not significantly different, demonstrated a tendency 
toward the same relationship. It does not appear that the slower, post- 
TLE latencies were a function of slow response practice prior to the TLE 
since the mean latencies of the slow and fast learners were essentially 
equal prior to the TLE. If the post-TLE differences were a function of sub- 
ject learning rate and If post-TLE latencies are Indeed a measure of over- 
learning, this suggests that the number of trials required for a subject to 
reach a response probability criterion may be correlated with the rate at 
which the associations are strengthened during overlearning. To achieve 
the same degree of retention, a slow learner may require more overlearning 
practice than a fast learner. Furthermore, post-TLE response latencies may 
provide a means of determining the amount of overlearning practice which 
would be required for a particular subject to assure a given degree of 
retention. 

Some Suggestions Concerning Measurement of the Learning Process 

With respect to the measures of correct response probability and 
response latency, the learning process appears to have two very distinct 
periods: early learning, the period prior to the point at which response 

probability reaches asymptote, and overlearning, the period during which 
latency undergoes Its greatest systematic variation. The bulk of experi- 
mentation In verbal learning has dealt with only one measure, response 
probability, and only the first phase of the learning process. 

It would appear that latency Is not a sensitive measure of associa- 
tive strength during the pre-TLE period. During this period, response 
probability seems to be the most accurate measure available. Response 
probability was sensitive to differences in the training method In that 
recall subjects reached a response probability criterion with fewer trials 
than did the anticipation method subjects. Pre-TLE response latencies were 
insensitive to the training method. Latencies did not reflect the Increase 
in associative strength Indicated by the Increase In correct response prob- 
ability from a chance level to 0.5A just prior to the TLE. Finally, laten- 
cies did not differentiate between correct and Incorrect responses during 
this period. 



Response latencies were indicative of the complexity of the task 
during the pre-TLE period in that latency was a function of the number 
of response alternatives. It may well be that latency would be useful as 
a measure of other task parameters which Influence learning. There is 
also a possibility that latency may be a more sensitive measure of the 
early stages of learning in more complex tasks. The learning task in 
the current experiment was intentionally kept very simple in that re- 
sponse learning was minimized. If the task had required an appreciable 
amount of response integration » the results obtained might have been quite 
different in that pre-TLE latencies might well vary systematically as a 
function of response learning. In such a learning situation » latency may 
be a useful supplement to response probability measures. 

During overlearning » after the TLE» the relative utility of the 
response probability and latency measures is reversed. The response 
probability measure becomes insensitive because it has reached asymptote 
and at about the same time, response latency seems to become a sensitive 
measure of associative strength. One cannot be sure that latency is 
measuring associative strength during this period until latency measures 
are checked against some other measure such as retention but there are 
several indications that this is the case. The rapid post-TLE decline 
in latency, of course, suggests the continued development of associative 
strength. Just as response probability was sensitive to differences in 
training method prior to the TLE, the post-TLE reduction in latency was 
more pronounced under the recall paradigm than under the anticipation 
paradigm. Post-TLE latencies appeared to be sensitive to differences 
in learning rate which were determined by response probability measures 
earlier in learning. This was true for both individual differences in sub- 
ject learning rate and differences in item difficulty. Latencies were a 
positive function of the number of response alternatives throughout the 
post-TLE period, as well as prior to the TLE, but the rate at which 
latency declined did not differ significantly between the different 
information levels. 

While it is evident that response probability measures are more 
useful than latency measures prior to the TLE and that latency may well 
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be e useful messure sfter the TLE» the utility of latency measures In the 
transition area around the TLE Is not at all clear. Is there an abrupt 
change In latency at the point at which response probability reaches 
asymptote or are the two transition points only roughly equivalent? The 
situation might be clarified by using more precise measurement techniques 
such as using a greater number of response alternatives. If this were 
done, the TLE would be a more accurate Indication of the point at which 
correct response probability reached asymptote. An extensive lnvestlga~ 
tlon of Individual Item protocols should also prove to be useful. It may 
well be the case, however, that response measures In this area demonstrate 
the Instability characteristic of other thresholds. 

In summary, the following statements can be made about latency mea- 
sures in the task used in the current experiment; (1) prior to the TLE, 
latency was a measure of task complexity but did not measure the develop- 
ment of associative strength; (2) during overlearning, response latency 
did appear to measure the continued development of associative strength. 
These results concerning latency measures provide a host of experimental 
questions for future research. The most obvious of these is whether or 
not the post-TLE decline in latency is actually indicative of the growth 
of associative strength. Can the degree of retention be controlled by 
training to a latency criterion? Do response latencies reach a stable 
asymptote and if so, does this asymptote have any implications for reten- 
tion? How does latency change over the course of learning in more complex 
tajks such as concept formation? Do latency measures have utility for 
instructional decisions in the early stages of such tasks? 

Ttfltenev Measurement in Computer— Assisted In struction 

Since this experiment concerned a rote drill situation, the gen- 
0 f£Xlty of the results and conclusions are somewhat limited with respect 
to other types of instructional situations but one broad statement may 
be made. It would appear that response latencies can be accurate measures 
of the learning process and hence can form an adequate bosls for instruc- 
tional decisions but their applicability may be limited to specific stages 
of learning. In a rote drill context, latencies early in learning, prior 
to the TLE, appear to contain little information of value for instructional 
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decisions. LatenciieB may be quite useful in a situation in which instruc- 
tional materials have been carefully prograamed so that correct response 
probability is always relatively high but they would seem to be least use- 
ful in situations in which probability of a correct response is very low. 

After the TLE, on the other hand, at the time when response proba- 
bility measures have reached asymptote in a rote drill situation, response 
latencies demonstrate their largest and most systematic variation. Inter- 
response variability also decreases during this period and this would in- 
crease the reliability of latency measures. These findings may have defin- 
ite implications for instructional decision making. In a spelling drill, 
for example, the goal of the instruction is not only that the student learn 
the association but also that the associations be retained. While it is 
known that overlearning Increases retention, the amount of overlearning to 
be provided has always been a relatively arbitrary decision. The capability 
of measuring response latency may provide a means of determining the optimal 
amount of overlearning practice for a particular student and a particular 
group of words. If it were found that response latencies were not shortened 
by an instructional program designed to bring a student to a high level of 
proficiency in a certain skill, the utility of the instructional procedures 
would be questionable. 
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Suamary 

The purpose of this experiment was to investigate response latency 
as a measure of associative strength or degree of learning and as a poss” 
ible basis for instructional decisions in computer- ass is ted instruction. 
Although latency is widely accepted as an indicant of associative strength , 
there has been little Investigation of systematic changes in latency over 
the course of verbal learning or of the factors which may Influence the 
relationship of latency to learning. Two parameters of the learning situ- 
ation which past research and theory had indicated could influence latency 
were investigated: training method and the amount of information trans- 

mitted by the subject per response, llie training variable contrasted the 
anticipation and recall paradigms In order to possibly uncover factors 
which contribute to the high variability characteristic of latency mea- 
sures. The information transfer variable was suggested by the traditional 
disjunctive reaction time studies which are undergoing re— examination In 
the light of theories of Information processing. The Investigation of 
several points concerning the relationship of latency to learning was 
suggested by recent experiments which have found systematic trends in 
latency measures with respect to the trial of last error (TLE) . 

A group of 96 subjects were run in a factorial design experiment under 
on-line computer control which examined changes in latency over the course 
of learning a short list of paired-associates. Anticipation and recall train- 
ing paradigms were contrasted and three levels of information transmission 
(one, two, or three bits of information) were investigated by the use of an 
eight word stimulus list and response lists of two, four or eight responses. 
The stimuli were CVC trlgrams of low association value and high similarity. 

The subjects indicated their responses by pressing unmarked buttons on a key- 
board. Knowledge of results was provided by lights next to the correct key 
positions. The training session continued until each item had received at 
least ten trials of practice after reaching a criterion of six successive 
errorless trials. The trial preceding the first of the six successive error- 
less trials was defined as the TLE. 

It was hypothesized that much of the variability characteristic of 
latency measures was due to Interference effects deriving from the nature of 
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the antlclpetlon peradlgn end that the duration and variability of laten- 
cies would be reduced under the recall paradlgni* The data obtained indi- 
cated that prior to the TLE, neither the duration nor variability of latency 
varied as a function of training method. Following the TLE, i.e., during 
overlearning 9 the recall paradigm resulted in shorter latencies than did 
anticipation. Subjects reached the response probability criterion in a 
smaller number of trials under the recall paradigm and the shorter post— 

TLE latencies may have reflected a similar superiority of the recall para- 
digm during overlearning. 

Prior to the TLE, latency was found to be a positive monotonlc func- 
tion or the potential number of bits of information in each task, that is, 
the amount of information which the subject was required to transmit for 
errorless responding. Immediately following the TLE, latency was a posi- 
tively accelerated function of the amount of information transmitted with 
the highest information level task having disproportionately long latencies. 

As practice progressed, the function approximated the linearity character- 
istic of increasingly complex disjunctive reaction time tasks. 

Several specific points were investigated with respect to systematic 
changes in response latency as a function of the stage of learning. Latencies 
remained relatively constant prior to the TLE and did not reflect the increase 
in associative strength indicated by a substantial increase in correct response 
probability. The latency of correct and incorrect responses did not differ 
systematically during this period. However, subsequent to the TLE, there was 
a large and consistent reduction in latency which did not appear to have 
reached asymptote after 16 post- TLE trials. In the area of the TLE Itself, 
no systematic trends could be reliably identified. This area might best be 
described as being similar to a threshold area in psychophysics in that while 
distinctly different behaviors occur on either side of the transition area, 
the behavior observed in the area Itself is highly inconsistent. 

aspects of latency as a function of learning rate were investi- 
gated. First, latency was found to vary as a positive function of intra- 
subject differences in item difficulty. For a particular subject, those items 
which required a greater number of trials to reach criterion had longer laten- 
cies both prior to and after the TLE. The post-TLE difference is particularly 
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interesting since, on the bssis of correct response probability alone, the 
items would be described as having attained equivalent degrees of learning. 
Secondly, it was found that latency prior to the TLE was a positive func- 
tion of subject learning rate. That is, slow learners were slow responders 
during the early stages of learning. Post-TLE latencies were Independent 
of subject learning rate. 

The latency of the first correct response to an item was found to be 
a function of the occurrence of subsequent errors in that the response was 
faster if there were no subsequent Incorrect responses to that item. 

In genera]., it was concluded that latency is not a sensitive measure 
of associative strength during the pre-TLE period but latency may well be 
an accurate measure of associative strength during overlearning, after the 
TLE. It has generally been accepted that response probability and response 
latency are similar measures of the degree of learning. Experiments generally 
employ either measure depending on the details of the experimental task. 

This study suggests that while response probability and latency do Indeed 
both measure strength of learning, they do so, at least in a rote verbal 
learning task, during different stages of learning. 
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